Senior Data Engineer IRC292526

Description

A leading organization in the media streaming industry focuses on delivering innovative solutions that enhance user engagement and content accessibility. The company caters to a diverse audience, including individual consumers and content creators, providing them with advanced tools for content production and distribution. With a strong emphasis on technology, the organization leverages cutting-edge AI and machine learning capabilities to optimize user experiences and operational efficiency. Their commitment to continuous improvement and adaptation positions them as a significant player in the evolving media landscape.

We are looking for an experienced Data Engineer to participate in desing and architectute of client’s data platform and GenAI initiatives. The primary focus of this role is building scalable distributed data processing systems that will serve as the foundation for the company’s intelligent services.

Work model: remote

Requirements

Required:

• Bachelor’s/Master’s degree in Computer Science, Computer Engineering, Machine Learning, or a related field.
• 4+ years of experience in software development, focusing on Python programming and data engineering.
• Strong expertise in Data Lake architecture and modern data warehousing.
• Hands-on experience with distributed computing systems (Apache Spark is a must).
• Strong Python proficiency for building complex pipelines and internal tooling.
• Good understanding of distributed systems principles, real-time data processing, and batch processing.
• Experience in scaling data infrastructure (AWS/GCP cloud solutions).
• Proven experience in designing and scaling vector databases (e.g. Pinecone, Milvus, Weaviate, pgvector etc.), experience in developing recommendation systems and retrieval-augmented generation (RAG) pipelines.
• Ability to independently drive technical discussions, make informed architectural assumptions, and justify technology choices.
• Ability to decompose complex “from scratch” tasks without detailed specifications.
  
  
  

Nice to have:

• Intermediate knowledge of Airflow for workflow management in data processing.
• Generative AI: Experience with vector databases, RAG architectures, or integrating LLMs into data pipelines.
• Experience designing and building middleware platforms, REST APIs, and distributed systems at scale.
• Web Development: Basic API development skills to provide data access to other services.
  
  
  

Job responsibilities

• Data Platform: Designing and maintaining high-load Spark pipelines for processing terabytes of data.
• GenAI Support: Building data infrastructure for training and operating generative models (ingestion, cleaning, vectorization).
• Architectural Contribution: Active participation in technical brainstorming, developing data quality standards, and processing protocols.
• Optimization: Identifying and resolving bottlenecks in current distributed processing systems.
  
  
  

What we offer

Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people’s lives.

Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.

DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.

Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.

Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.

Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.