Back to search

AI Data Engineer 3

  • Redmond, Washington, United States
  • $85–$90 per hour
  • Posted Nov 9, 2026
INDUSTRYSoftware & InternetAI & Machine Learning

Responsibilities

  • Develop, maintain, and optimize Python pipelines for data ingestion, OCR processing, text extraction, cleaning, normalization, and deduplication.
  • Run and monitor large-scale batch processing jobs, investigate failures, and implement reliable retry and recovery mechanisms.
  • Build automated quality checks to identify missing or corrupted files, incomplete OCR outputs, duplicate content, formatting issues, and metadata inconsistencies.
  • Prepare training-ready datasets through filtering, text segmentation, tokenization, and conversion into agreed data formats.
  • Manage bulk uploads, downloads, and synchronization between local processing environments and Azure storage; verify transfer completeness and data integrity.

Requirements

Nice to have: OCR pipelines, Azure Databricks, Azure Machine Learning, Azure Data Factory, Hugging Face Datasets, tokenization, near-duplicate detection, training/evaluation data separation

Skills

data engineeringdata pipeline developmentdata sciencePythonprocessing large structured and unstructured datasetsAzure Blob StorageAzure Data Lake StorageOCR pipelinesAzure DatabricksAzure Machine LearningAzure Data FactoryHugging Face Datasetstokenizationnear-duplicate detectiontraining/evaluation data separationPythonAzure Blob StorageAzure Data Lake StorageAzure DatabricksAzure Machine LearningAzure Data FactoryHugging Face Datasets

Benefits

  • End-to-end AI data management and dataset curation.
  • Collaborative work environment.
  • Opportunities for professional growth and development.

More jobs nearby

Full description

Job Title: AI Data Engineer 3 Location: Redmond WA Salary Range: $85/hr to $90/hr on W2 Introduction We are seeking a hands-on Data Pipeline Engineer to build and operate Python-based workflows that transform large document and text datasets into high-quality data for AI model training. This role combines OCR processing, data cleaning and validation, scalable pipeline development, and Azure storage management. Required Skills & Qualifications Demonstrated experience in data engineering, data pipeline development, or a data science role with substantial production programming responsibilities. Strong proficiency in Python, including writing reusable modules, debugging, testing, logging, and handling processing errors. Hands-on experience processing large structured and unstructured datasets using memory-efficient, parallel, or distributed techniques. Practical experience with Azure Blob Storage or Azure Data Lake Storage, including bulk data transfers, storage organization, and access troubleshooting. Experience with OCR pipelines, scanned documents, multilingual text, or document-layout processing. Experience with Azure Databricks, Azure Machine Learning, Azure Data Factory, or workflow orchestration tools. Familiarity with Hugging Face Datasets, tokenization, near-duplicate detection, and training/evaluation data separation. Prior work experience at client . Applicants must be able to work directly for Artech on W2. Preferred Skills & Qualifications Experience with OCR pipelines, scanned documents, multilingual text, or document-layout processing. Experience with Azure Databricks, Azure Machine Learning, Azure Data Factory, or workflow orchestration tools. Familiarity with Hugging Face Datasets, tokenization, near-duplicate detection, and training/evaluation data separation. Day-to-Day Responsibilities Develop, maintain, and optimize Python pipelines for data ingestion, OCR processing, text extraction, cleaning, normalization, and deduplication. Run and monitor large-scale batch processing jobs, investigate failures, and implement reliable retry and recovery mechanisms. Build automated quality checks to identify missing or corrupted files, incomplete OCR outputs, duplicate content, formatting issues, and metadata inconsistencies. Prepare training-ready datasets through filtering, text segmentation, tokenization, and conversion into agreed data formats. Manage bulk uploads, downloads, and synchronization between local processing environments and Azure storage; verify transfer completeness and data integrity. Company Benefits & Culture End-to-end AI data management and dataset curation. Collaborative work environment. Opportunities for professional growth and development. For immediate consideration please click APPLY to begin the screening process with Alex.

AI Data Engineer 3 at Artech LLC | Referso Jobs