Back to search

Data Architect

Own the end-to-end data architecture that turns raw multimodal sensor and operational data into governed, versioned, and AI-ready datasets for training, evaluation, and simulation.

  • Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics

Responsibilities

  • Define target-state data architecture, storage layout, zones, partitioning, and retention for high-volume sensor and metadata stores.
  • Design canonical data models, schemas, data contracts, and metadata standards across ingestion, curation, annotation, and publishing.
  • Establish lineage, dataset versioning, data quality rules, access controls, and governance policies.
  • Evaluate and select platform components, and set reference patterns for batch, streaming, and search/retrieval of large datasets.
  • Optimize cost, performance, and scalability of storage and compute, and review designs for security and compliance.

Requirements

  • Experience in a Autonomous systems
  • Experience in a Robotics

Nice to have: Multimodal sensor data, LiDAR, GNSS, IMU, telemetry, ROS, ROS2, Databricks, Snowflake, Unity Catalog, Purview, DataHub, MLOps, feature stores, industrial IoT

Skills

Data engineeringData architectureLakehouse architectureData lake architecturesAWSAzureDeltaIcebergParquetData modelingMetadata managementLineageDataset versioningData qualitySecurityGovernanceSparkKafkaAirflowPythonSQLAWSAzureDeltaIcebergParquetSparkKafkaAirflowPythonSQLDatabricksSnowflake

Full description

Job Description - Data Architect Must Have Technical/Functional Skills Extensive experience in data engineering and data architecture, including substantial experience as an architect designing production-scale data platforms. Proven design of lakehouse or data lake architectures on AWS or Azure, including object storage, compute, and open table formats (Delta, Iceberg, Parquet). Data modeling for structured, semi-structured, and unstructured data, including large binary files with rich metadata. Strong grounding in metadata management, lineage, dataset versioning, data quality, security, and governance. Hands-on with batch and streaming patterns (Spark, Kafka, Airflow or equivalents) and strong Python/SQL. Good to Have Multimodal sensor data (video, LiDAR, GNSS, IMU, telemetry), ROS/ROS2 bag data, autonomous systems or robotics, Databricks, Snowflake, data catalogs (Unity Catalog, Purview, DataHub), MLOps and feature stores, or industrial IoT. Roles & Responsibilities Own the end-to-end data architecture that turns raw multimodal sensor and operational data into governed, versioned, and AI-ready datasets for training, evaluation, and simulation. Define target-state data architecture, storage layout, zones, partitioning, and retention for high-volume sensor and metadata stores. Design canonical data models, schemas, data contracts, and metadata standards across ingestion, curation, annotation, and publishing. Establish lineage, dataset versioning, data quality rules, access controls, and governance policies. Evaluate and select platform components, and set reference patterns for batch, streaming, and search/retrieval of large datasets. Optimize cost, performance, and scalability of storage and compute, and review designs for security and compliance. Generic Managerial Skills, If Any Provide technical direction to data engineering teams, run architecture and design reviews, document decisions, and align AI, annotation, simulation, security, and platform stakeholders on data standards and roadmap.

Data Architect at ClifyX, INC | Referso Jobs