AumRaj Design Systems Pvt Ltd

Sr. Big Data Engineer Vertical Engineering

AumRaj Design Systems Pvt Ltd  San Jose, CA, USA

Employement Types : Full Time

Job Description
(Only for for US citizen -OR- GC holder -OR- with valid work permit only)
 Looking for an expert who knows how to run Big Data platform software such as Hive/Tez/LLAP, Yarn, HDFS.
 We are doing TPC-DS bench marking but lacking some expertise so we would like to quickly bring in someone who has done this before and have the right expertise.
 Big Data engineer requiring expertise in Big Data platforms and Technologies, Object Storage, Databases, Networking and system performance.
 He or she will join a team of experts in researching and developing innovative storage solutions. The ideal candidate must have experience with managing and optimizing performance on Big Data platforms with large data sets.
Responsibilities:
 Deploy Big Data frameworks including Hive, Spark, and Presto and optimize performance for TPC-DS or similar benchmarks
 Analyze and improve stability, efficiency, and scalability of the platform
 Collaborate with design engineers to find solutions for improving benchmark performance using various storage technologies
 Apache Hadoop and data ETL, ingestion and processing with Hadoop tools
 Knowledge of building a scalable and integrated Data Lake for an Enterprise
Requirements:
A BS or MS in Computer Science, Machine Learning or Statistics, Mathematics or related field.
 3-10 years of experience in Big Data/Storage or related field, debug, tuning and performance analysis.
 Expertise in running and optimizing TPC-DS benchmarks on Hive, Spark, Presto
 Expertise in SQL, Hive/Tez/LLAP, Spark and Presto
 Expertise in Hadoop, HBase, Yarn
• Expertise on Big Data platforms provided by Hortonworks or Cloudera
 Good knowledge of competitive environment and existing TPC benchmarks
 Good working knowledge of the Linux, VMware OS
 Knowledge and experience in analyzing large data sets
 Strong software engineering skills with efficient, maintainable and testable C/ C++/Python/Java/Scala is required.
 Working knowledge of data center tiers and the server system trade-offs involved is beneficial. Skills and Abilities
 Must be highly motivated with excellent verbal and written communication skills.
 Ability to meet aggressive project deadlines in a team environment
 Ability to work successfully with cross-functional teams, including coordinating across organizational boundaries and geographies.
 Should be a US citizen -OR- GC holder -OR- with valid work permit only.
Company Information
  • Contact Person :  ************
  • Phone No. :  **********
  • Email Id :  *****@****.com

2019-08-30 13:01:29 12000 / Salary 5-8 Years

Recommended jobs for you

Sr. Big Data Software Engineer

MSL’s vision is to solve key problems & optimize architecture solutions for Cloud Computing, Big Data and High Performance data center environments.....

Samsung SeSan Jose, CA 30+ days ago Apply Now

Senior Data Scientist

At Quantifind, we look to integrate large amounts of data from diverse data sources (structured financial data or unstructured social data) to drive important…....

QuantifindMenlo Park, CA 13 months ago Apply Now

Sr. Business Development Partner Manager

Are you ready for the big time? Combination of twelve years' sales and customer facing engineering experience. At Sprint, we're more than just talk.....

SprintSan Jose, CA 22 days ago Apply Now

Associate Product Manager, AMD Based Servers

Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data,…....

Super MicrSan Jose, CA 30+ days ago Apply Now

Senior Engineer: Big Data Platform Palo Alto, CA

Strong background in performance tuning of Big data open source platform. 4+ years of experience on developing Big Data Platform using open source technologies.....

VMwarePalo Alto, CA 3 days ago Apply Now

Recent from Blog

The Jobrino blog is written with jobseeker and employers in mind to enable them to realize their full potential. Jobrino blog is your one-stop destination to find new research about the workplace and the latest insights into the employment market.