Data Engineer / Data Scientist

Company Overview

[Company overview is not specified.]

Job Summary

The Data Engineer / Data Scientist will design and implement core data pipelines and semantic data models for the AI Platform. This role is essential for enabling high-quality retrieval, grounding, and reducing hallucination for multi-domain Large Language Model (LLM) applications.

Responsibilities

• Design and implement data pipelines to ensure seamless data flow for AI applications.
• Develop semantic data models that enhance data retrieval processes.
• Improve the quality of data used in multi-domain LLM applications.
• Collaborate with cross-functional teams to integrate data models with existing systems.
• Monitor and optimize data retrieval processes to minimize data hallucination.

Qualifications

• Education: Bachelor's or Master’s degree in Computer Science, Data Science, Information Technology, or a related field.
• Experience: 5+ years in data engineering or data science.
• Technical Skills:
  • Strong proficiency in Python and SQL.
  • Hands-on experience with ETL/ELT systems.
  • Knowledge of GraphQL schema design.
  • Experience with at least one vector database (e.g., Pinecone, Milvus, Weaviate, FAISS).
  • Solid understanding of embeddings, chunking, metadata enrichment, and retrieval pipelines.
  • Familiarity with Airflow, Spark, Flink, or similar data processing frameworks.

Preferred Skills

• Certifications in Data Engineering or related fields are a plus.
• Experience with machine learning frameworks and libraries.

Experience

• Minimum of 5 years in data engineering or data science roles, focusing on data pipeline construction and semantic data modeling.

Environment

[Work setting, location (remote, in-office, hybrid), and physical or environmental conditions are not specified.]

Salary

[Salary details are not specified.]

Growth Opportunities

[Career advancement opportunities within the company are not specified.]

Benefits

[Benefits such as insurance, paid leave, or work policies are not specified.]