- San Francisco, California, United States
- Senior
- $170K–$205K per year
- 5+ years
Build the Managed Data Transfer control plane, including API, scheduler, and job state for petabyte-scale data movement across clouds.
Compensation
Compensation will be paid in the range of up to $170,000 - $205,000 + Bonus. Restricted Stock Units are included in all offers.
Responsibilities
- Design and build the data-transfer API (create, list, get, cancel) with a provider-neutral model for sources and destinations
- Build the scheduler and state machine that split a bucket listing into units of work, place them on regional worker pools, and track progress, retries and resume across failures
- Ensure correctness at scale with end-to-end checksum verification and clear error handling
- Implement secure access to customer buckets with short-lived, least-privilege credentials integrated with Crusoe IAM and audit logging
- Ship the CLI and Terraform and Console experiences for creating and monitoring transfers
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent professional experience
- Nice to have: S3 multipart uploads
- Nice to have: rclone
- Nice to have: s5cmd
- Nice to have: AWS DataSync
Skills
Benefits
- Competitive compensation and equity packages
- Restricted Stock Units
- Paid time off, paid holidays & leave of absence programs
- Comprehensive health, dental & vision insurance
- Employer contributions to HSA account