Hadoop Developer Job at innovitusa, Des Moines, IA

NFFTQ1QrM2E0VGU5Vll2UzZDT0tXblhVWFE9PQ==
  • innovitusa
  • Des Moines, IA

Job Description

Hiring: W2 Candidates Only

Visa: Open to any visa type with valid work authorization in the USA

Key Responsibilities

  • Design, develop, and implement scalable big data solutions using Hadoop .

  • Work with Hadoop ecosystem tools such as HDFS, MapReduce, YARN, Hive, Pig, HBase, and Spark .

  • Develop and optimize ETL pipelines for large datasets.

  • Write and optimize HiveQL queries for data analysis and reporting.

  • Integrate Hadoop systems with data sources like RDBMS, NoSQL databases, and streaming systems .

  • Monitor Hadoop cluster performance and troubleshoot issues.

  • Ensure data security, governance, and compliance.

  • Collaborate with data engineers, data scientists, and business teams.

  • Document system designs, workflows, and best practices.

Required Skills

  • Strong experience with Hadoop framework and ecosystem .

  • Proficiency in Java, Scala, or Python .

  • Hands-on experience with Hive, Pig, HBase, Spark, and Sqoop .

  • Knowledge of Linux/Unix environments.

  • Experience with SQL and NoSQL databases .

  • Understanding of distributed systems and data processing concepts .

  • Familiarity with data warehousing and ETL tools .

Preferred Qualifications

  • Experience with Apache Spark and real-time processing tools like Kafka or Flume .

  • Knowledge of cloud platforms (AWS EMR, Azure HDInsight, or Google Dataproc).

  • Understanding of DevOps tools (Git, Jenkins, CI/CD pipelines).

  • Hadoop certification (Cloudera, Hortonworks) is a plus.

Education & Experience

  • Bachelor’s degree in Computer Science, Engineering, or related field .

  • 8 years of experience in Big Data or Hadoop development (varies by role level).

Job Tags

Similar Jobs

Actus consulting

Japanese/English Bilingual日系ビールアンバサダー兼営業アシスタント - NYC, New York#12033 Job at Actus consulting

 ...A Japanese food company is hiring a sales support person. / SNS 2... 

TVW

Janitor I - Portland Job at TVW

 ...potential and make meaningful contributions to society. Sustainable Cleaning Systems: Sustainable Cleaning Systems has supported work...  ...and completes janitorial assignments and checklists for each contract to ensure the highest level of janitorial service is provided.... 

Concentrix

After-Sales Customer Service for Smart Home Appliances(Spanish, Italian, German, French) Job at Concentrix

 ...BesidesThe two rest days per week may not be consecutive Saturdays and Sundays. 1.Provide customers with accurate and professional consulting services in small languages via email, online platforms, and inbound calls., ensuring their issues are resolved in a timely manner.... 

Peraton

Strategic Talent Pipeline - Upcoming CBP Initiatives Job at Peraton

 ...building a pipeline of qualified candidates in anticipation of upcoming opportunities supporting U.S. Customs and Border Protection (CBP) across multiple critical programs. These efforts will require a wide range of technical and functional expertise to support CBP's... 

University of California, Berkeley

Staff Research Associate (9613C), Molecular & Cell Biology - 83011 Job at University of California, Berkeley

 ...Staff Research Associate (9613C), Molecular & Cell Biology - 83011 About Berkeley At the University of California, Berkeley, we...  ...manipulation (e.g., attaching eartags, tail snipping). Bachelor's degree in the biomedical or health sciences or related area and/or...