As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.
Locations (3)
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States
Compensation
Remote Software Developer ($200/hr)
Responsibilities
Curate code examples for training, benchmarking, and advancing large language models
Provide precise solutions and make corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go
Evaluate and refine AI-generated code for efficiency, scalability, and reliability
Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions
Build agents that can verify the quality of the code and identify error patterns
As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.
Tax Law experts join projects that fine-tune AI models like ChatGPT, applying expertise in federal income tax, corporate tax planning, partnership taxation, and tax controversy to evaluate how AI handles complex tax scenarios.
Locations (3)
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States
Responsibilities
Review and evaluate AI-generated responses to U.S. tax law hypotheticals
Apply a structured legal rubric to assess issue spotting, accuracy of Internal Revenue Code provisions, and proper application of Treasury Regulations and IRS guidance
Identify gaps in AI reasoning around basis calculations, gain recognition, tax credits, transfer pricing, and tax-exempt organization rules
Provide detailed, high-quality annotations and written feedback to refine AI models
Experienced, hands-on software engineers to help evaluate and improve AI coding models by reviewing generated code and agent behavior, determining technical correctness, and creating evaluation signals and feedback.
Design and solve real-world property management and concierge scenarios to test AI reasoning, leveraging industry knowledge to improve AI in real estate operations.
Locations (3)
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States
Compensation
Strong compensation (exact amount varies by project).
Responsibilities
Design and solve real-world property management and concierge scenarios to test AI reasoning
Work on projects to help evaluate and improve AI using real estate industry knowledge and communication expertise, designing and solving real-world brokerage and transaction scenarios to test AI reasoning.
Locations (3)
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States
Compensation
Strong compensation (exact amount varies by project).
Responsibilities
Design and solve real-world brokerage and transaction scenarios to test AI reasoning
Turing invites Real Estate and Property Law experts to join projects that fine-tune AI models. You will apply your expertise in commercial real estate transactions, land use and zoning, title examination, and landlord-tenant disputes to evaluate how AI reasons about property law.
Locations (3)
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States
Responsibilities
Review and evaluate AI-generated responses to U.S. property law hypotheticals, including commercial purchase agreements, title defects, zoning variances, landlord-tenant disputes, and mortgage foreclosure proceedings.
Apply a structured legal rubric to assess issue spotting, accuracy of property doctrines, and proper application of recording statutes, the Rule Against Perpetuities, and state landlord-tenant codes.
Leverage expertise in pulmonary and critical care medicine to fine-tune large language models (like ChatGPT), ensuring AI systems deliver accurate, empathetic, and safe medical reasoning.
Locations (3)
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States
Responsibilities
Design and solve advanced clinical scenarios reflecting pulmonary and critical care practice
Evaluate AI-generated responses for diagnostic accuracy, clinical judgment, and evidence-based reasoning
Identify gaps in AI understanding across pulmonology and intensive care
Collaborate with AI researchers and medical peers to improve model quality and reliability
Provide structured, expert feedback that informs next-generation AI development