Position : Sr. Big Data Engineer
Sr. Big Data Engineers are tasked with designing and implementing big data solutions with TB and PB daily transaction volume. This is a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and business architects.
Lead, design, develop, document, and test big data solutions.
Deliver solutions for using an Agile Development model
Create quality deliverables to communicate technical solutions to appropriate audiences.
Understand issues, problem solving and design/architect solutions
Install and integrate various big data applications
Configure and troubleshoot issues in big data framework
Build and collaborate with business and technical teams to deliver software
Learn continuously, leveraging training resources and self-directed training, sharing knowledge and skills with others.
Provide mentoring and leadership to more junior resources.
Passion for technology and willingness to learn is required
Have ability to work in a fast paced and dynamic work environment and be able to produce efficient and robust solution
High energy, confidence, and agility to drive a team
Candid and direct communication
A creative thinker who can bring in new ideas and innovations to the company.
Bachelors in information technology, computer science, application development, programming, or related degree and/or equivalent work experience
6+ years of Java development experience in large scale enterprise development
2+ years of Scala and Python programming
2+ years of development experience in the field of big data on a PetaByte Scale environment (e.g. Hadoop, KafKa, Couch Base, Cassandra)
2+ years of Hadoop, Map-Reduce, HDFS and Hive
2+ years of Spark, Spark Streaming and Spark SQL
Strong with Real time analytics using stream processing frameworks such like Spark / Storm - Mandatory
Expert knowledge of Big Data querying tools, such as Spark, Pig, Hive, and Impala
Advanced knowledge in Data Structure, OOP/OOD, SQL/NoSQL Database
Strong in multiple threading development and advanced performance tuning
Knowledge of how to assess the performance of data solutions, how to diagnose performance problems, and tools used to monitor and tune performance
Excellent communication skills with both Technical and Business audience
|Salary||0 to 0|
|Years of Experience ||5+ to 10 years|
|Minimum Education ||-|
|Willingness to Travel||-|
|Hours per week||0|