Job Description

Key Roles & Responsibilities

Lead and oversee the end-to-end design, implementation, and optimization of data pipelines supporting key customer onboarding, transaction, and decisioning workflows.
Architect and implement data ingestion, transformation, and storage frameworks leveraging Hadoop , Avro , and distributed data processing technologies.
Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions that enhance real-time data accessibility and reliability.
Provide technical leadership and mentorship to a team of data engineers, ensuring adherence to coding, performance, and data quality standards.
Design and implement robust data frameworks to support next-generation customer and business product launches.
Develop best practices for data governance , security , and compliance aligned with enterprise and regulatory requirements.
Drive optimization of existing data pipelines and workflows for improved efficiency, scalability, and maintainability.
Collaborate closely with analytics and risk modeling teams to ensure data readiness for predictive insights and strategic decision-making.
Evaluate and integrate emerging data technologies to future-proof the data platform and enhance performance.

Must-Have Skills

8–10 years of experience in data engineering , with at least 2–3 years in a technical leadership role .
Strong expertise in the Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig, etc.).
Experience working with Avro , Parquet , or other serialization formats.
Proven ability to design and maintain ETL / ELT pipelines using tools such as Spark , Flink , Airflow , or NiFi .
Proficiency in Python , Scala for large-scale data processing.
Strong understanding of data modeling , data warehousing , and data lake architectures.
Hands-on experience with SQL and both relational and NoSQL data stores.
Cloud data platform experience with AWS .
Deep understanding of data security , compliance , and governance frameworks .
Excellent problem-solving, communication, and leadership skills.

Job Tags

Similar Jobs

Mysource

Social Media Manager Job at Mysource

...similar role* Excellent copywriting and content creation skills* Strong knowledge of platforms like Facebook, Instagram, LinkedIn, TikTok, X/Twitter, etc.* Ability to analyze metrics and improve performance* Creative, organized, and able to manage multiple...

Aramark

Warehouse Worker Job at Aramark

Job Description The Warehouse Workers main responsibilities include receiving and processing incoming products, preparing orders for transport, and performing inventory and quality control duties. This person ensures the warehouse is clean and organized, maintained...

TA Dispatch

Human Resources Internship - Summer Job at TA Dispatch

...Sound like the kind of team you want to be part of? Lets take a closer look at the role. Job Description The Human Resources Internship is designed to provide hands-on experience in core HR functions, including talent acquisition, employee engagement, HR...

The Independents

Account Manager, Lifestyle & Hospitality Job at The Independents

...representing some of the most prestigious names in fashion, beauty, and lifestyle. In 2017, Karla Otto merged with K2 to form THE INDEPENDENTS... ...our future growth as an agency, we are looking for an Account Manager, Lifestyle & Hospitality to join our team based in our NYC...

Vend Guys

Social Media Video Editor Job at Vend Guys

...a remote position. Were looking for a creative video editor who can turn our raw footage into snappy, high-energy videos for TikTok, YouTube, and other social platforms. You should know how to add music, text, effects, and pacing that keeps viewers hooked...

Data Engineering Tech Lead - Hadoop Job at Cloud Analytics Technologies LLC, Cleveland, OH

N3dhRlIrM2Y1ekM5VVliYTdTT0pYMzdRWGc9PQ==