Back to search

Data Engineer

Seeking a Data Engineer to build, optimize, and support scalable data pipelines and platform services in a distributed environment. This role requires strong hands-on experience with Python, PySpark, and SQL, with an emphasis on developing reliable, scalable data solutions.

  • Remote, United States
  • Contract
  • Remote
  • Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics

Responsibilities

  • Develop and enhance data processing, orchestration, monitoring, and related capabilities using open-source software, AWS, and GitLab automation.
  • Design, build, and optimize scalable data pipelines in distributed environments.
  • Collaborate with product and technology teams to design and validate data platform capabilities.
  • Identify, design, and implement process improvements by automating manual processes, improving usability, and redesigning solutions for greater scalability.
  • Provide technical support and usage guidance to users of the platform’s services.
  • Create and refine metrics, monitoring, and alerting mechanisms to improve visibility into production services.

Requirements

  • Experience in a Data Engineering

Nice to have: Palantir Foundry, Workshop, Quiver, Slate

Skills

PySparkPythonSQLAWSLinuxPythonPySparkSQLAmazon Web Services (AWS)LinuxGitLab automationGit/BitbucketJenkinsAWS CodeBuildAWS CodePipelinePlatform monitoring and alerting toolsPalantir Foundry

More jobs nearby

Full description

Job Title - Data Engineer Duration - 12 Month Contract Location - US Remote Must have 4+ years of advanced working experience with PySpark as well. Summary: Seeking a Data Engineer to build, optimize, and support scalable data pipelines and platform services in a distributed environment. This role requires strong hands-on experience with Python, PySpark, and SQL, with an emphasis on developing reliable, scalable data solutions. Responsibilities: Develop and enhance data processing, orchestration, monitoring, and related capabilities using open-source software, AWS, and GitLab automation. Design, build, and optimize scalable data pipelines in distributed environments. Collaborate with product and technology teams to design and validate data platform capabilities. Identify, design, and implement process improvements by automating manual processes, improving usability, and redesigning solutions for greater scalability. Provide technical support and usage guidance to users of the platform’s services. Create and refine metrics, monitoring, and alerting mechanisms to improve visibility into production services. Qualifications: 4+ years of advanced working experience with SQL, Python, and PySpark. Strong experience designing, building, and optimizing scalable data pipelines in a distributed environment. Experience with data processing, transformation, orchestration, and automation. Experience working with AWS and cloud-based data environments. Experience supporting and collaborating with cross-functional product and technology teams. Proficiency working in a Linux environment. Experience with platform monitoring and alerting tools. Experience with source control and continuous integration/continuous delivery (CI/CD) processes. Preferred Qualifications: Experience with Palantir Foundry. Knowledge of Palantir Foundry capabilities, including Workshop, Quiver, and Slate. Experience developing data workflows, visualizations, or user-facing solutions within Foundry. Tools and Technologies: Python and PySpark SQL Amazon Web Services (AWS) Linux GitLab automation Git/Bitbucket Jenkins, AWS CodeBuild, and AWS CodePipeline Platform monitoring and alerting tools Palantir Foundry, Workshop, Quiver, and Slate (preferred)

Data Engineer at ITCO Solutions | Referso Jobs