- San Diego, California, United States
- Full-time · Senior
Build and lead data platform services for Shield AI’s AI Factory, designing APIs, dataset versioning, search, and metadata systems to support machine‑learning workflows.
Compensation
Pay within range listed + Bonus + Benefits + Equity
Responsibilities
- Design and implement data APIs and catalog services
- Integrate LanceDB for indexing and search
- Create APIs for dataset versioning and access control
- Track data provenance and changes
- Design schema validation, compatibility, and migration mechanisms
Requirements
- Nice to have: LanceDB
- Nice to have: Arrow
- Nice to have: Parquet
- Nice to have: dataset catalogs
- Nice to have: provenance