(Only for for US citizen -OR- GC holder -OR- with valid work permit only) Looking for an expert who knows how to run Big Data platform software such as Hive/Tez/LLAP, Yarn, HDFS. We are doing TPC-DS bench marking but lacking some expertise so we would like to quickly bring in someone who has done this before and have the right expertise. Big Data engineer requiring expertise in Big Data platforms and Technologies, Object Storage, Databases, Networking and system performance. He or she will join a team of experts in researching and developing innovative storage solutions. The ideal candidate must have experience with managing and optimizing performance on Big Data platforms with large data sets. Responsibilities: Deploy Big Data frameworks including Hive, Spark, and Presto and optimize performance for TPC-DS or similar benchmarks Analyze and improve stability, efficiency, and scalability of the platform Collaborate with design engineers to find solutions for improving benchmark performance using various storage technologies Apache Hadoop and data ETL, ingestion and processing with Hadoop tools Knowledge of building a scalable and integrated Data Lake for an Enterprise Requirements: A BS or MS in Computer Science, Machine Learning or Statistics, Mathematics or related field. 3-10 years of experience in Big Data/Storage or related field, debug, tuning and performance analysis. Expertise in running and optimizing TPC-DS benchmarks on Hive, Spark, Presto Expertise in SQL, Hive/Tez/LLAP, Spark and Presto Expertise in Hadoop, HBase, Yarn • Expertise on Big Data platforms provided by Hortonworks or Cloudera Good knowledge of competitive environment and existing TPC benchmarks Good working knowledge of the Linux, VMware OS Knowledge and experience in analyzing large data sets Strong software engineering skills with efficient, maintainable and testable C/ C++/Python/Java/Scala is required. Working knowledge of data center tiers and the server system trade-offs involved is beneficial. Skills and Abilities Must be highly motivated with excellent verbal and written communication skills. Ability to meet aggressive project deadlines in a team environment Ability to work successfully with cross-functional teams, including coordinating across organizational boundaries and geographies. Should be a US citizen -OR- GC holder -OR- with valid work permit only.
The Jobrino blog is written with jobseeker and employers in mind to enable them to realize their full potential. Jobrino blog is your one-stop destination to find new research about the workplace and the latest insights into the employment market.