AI Data Engineer
- Bengaluru, Karnataka, India
- Full-time
- ₹5M–₹7M per year
- Posted Nov 9, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of structured and unstructured data
- Build reliable batch and real-time data processing systems to support AI/ML applications
- Develop data ingestion, transformation, integration, and orchestration frameworks
- Optimize data workflows for performance, scalability, and cost efficiency
- Build and maintain data infrastructure supporting machine learning, deep learning, and Generative AI applications
- Develop data pipelines for model training, validation, testing, and deployment
- Work with vector databases, embeddings, and retrieval-augmented generation (RAG) architectures
- Prepare, clean, transform, and validate datasets for AI model development
- Support feature engineering, feature stores, and model data management
- Design scalable data architectures using modern data platforms and distributed computing frameworks
- Work with cloud environments such as AWS, Microsoft Azure, or Google Cloud Platform
- Implement data lakes, data warehouses, and lakehouse architectures
- Leverage technologies such as Apache Spark, Kafka, Airflow, Databricks, Snowflake, and Delta Lake
- Establish data quality checks, monitoring, validation, and observability frameworks
- Ensure data consistency, integrity, security, and compliance
- Implement access controls, metadata management, and data governance practices
- Identify and resolve data pipeline bottlenecks and infrastructure issues
- Collaborate with AI engineers, ML engineers, data scientists, and product teams
- Lead technical discussions, architecture decisions, and engineering best practices
- Mentor junior engineers and drive continuous improvements in data engineering processes
- Evaluate emerging AI and data technologies to improve platform capabilities
Requirements
- Experience in a AI/ML
- Experience in a Data Engineering
Nice to have: LLMs, LangChain, LlamaIndex, MLOps, feature stores, model lifecycle management, Databricks, Snowflake, BigQuery, Redshift, data observability tools, governance tools
Skills
PythonSQLApache SparkKafkaAirflowdistributed data systemsETL/ELT pipelinesmodern data architecturesAI/ML data workflowsGenerative AI infrastructurecloud platformsAWSAzureGCPvector databasesembeddingsRAG pipelinesdata warehousesdata lakeslakehouse platformsdatabase technologiesdata modellingoptimization techniquesDockerKubernetesCI/CDinfrastructure automationApache SparkKafkaAirflowDatabricksSnowflakeDelta LakeAWSAzureGCPDockerKubernetesCI/CDLangChainLlamaIndexBigQueryRedshift
Full description
Company details are for members
Sign up for a free job alert to see Weekday AI's profile, website and LinkedIn, and the same for every employer on Referso Jobs.