The Evals team measures the performance and capabilities of internal and external models, helping teams across Magic make informed decisions. As a Member of Technical Staff on Evals, you will develop new benchmarks and evaluation methodologies, run data ablations, assess dataset quality, and investigate whether our measurements accurately reflect model performance.
Compensation
Annual salary range between $200K - $550K depending on experience
Equity is a significant part of total compensation, in addition to salary
Responsibilities
Design and validate new evaluations and benchmarks across model training and deployment
Investigate model behavior and identify gaps in existing evaluations
Measure dataset quality and identify opportunities to improve training data
Improve evaluation correctness, reproducibility, and reliability
Audit and improve upon public benchmarks, research papers, and open-source implementations
The focus of this role is on achieving results which are aligned with the larger picture of the organization and its strategic goals. Initiative, coupled with a sense of competitive drive, and the ability to stay focused on results despite changing conditions, is the key to achieving the performance objectives of this job.
Compensation
Hi, I confirm my pay rate is BRL 24K per month, plus benefits.
Responsibilities
Monitor and facilitate activities for development, enhancement and continuous improvement for Windchill projects
Working on activities and assignments for Windchill and providing expertise and assistance to the projects for resolution of issues and execution of processes
Analyze, translate, and define business requirements into technical solutions
Follows quality processes for tasks with appropriate reviews
Requirements
Degree in Information Technology discipline or equivalent experience (BE/BTech)
Support sound consumer and commercial credit decisions by analyzing applications, assessing risk, and preparing recommendations within established policies and guidelines.
Compensation
The base range for this role is: $52,000-$93,500
Responsibilities
Analyze information received from credit applications and credit reporting agencies to make prudent credit decisions
Maintain and exceed established standards and targets while adhering to all credit policies, procedures and guidelines
Escalate credit applications that exceed discretionary limits and established guidelines
Conduct reference investigations, document requirements and prepare credit recommendations
Ensure compliance with Anti-Money Laundering policies and procedures
Requirements
College or University business diploma or equivalent
Support sound consumer and commercial credit decisions by analyzing applications, assessing risk, and preparing recommendations within established policies and guidelines.
Compensation
The base range for this role is: $52,000-$93,500
Responsibilities
Analyze information received from credit applications and credit reporting agencies to make prudent credit decisions
Analyze and evaluate
Maintain/exceed established standards and targets while adhering to all credit policies, procedures and guidelines
Escalate with recommendation those credit applications that exceed discretionary limits and established guidelines
Conduct reference investigations, document requirements and prepare credit recommendations
Requirements
College or University business diploma or equivalent experience
Develop and implement maintenance strategies for automated systems, including preventive, predictive and corrective approaches for PLC-controlled machines, robotics and integrated production equipment.
Compensation
Competitive compensation and benefits package
Responsibilities
Develop and implement maintenance strategies for automated systems
Drive reliability improvement of automation systems
Lead structured root cause analysis (RCA, A3, 5 Why) for automation, control and system integration issues
Own performance of control and automation systems
Define and optimize maintenance plans and standards for electrical and mechatronic systems
Requirements
Bachelor's Degree in electrical engineering, automation engineering, mechatronics or a similar qualification
Assist with independent valuations of insurance-linked securities and reinsurance positions, support actuarial model development, and review portfolio valuations.
Responsibilities
Assist with the independent valuations of insurance-linked securities and reinsurance positions, including data checks/manipulation, model runs and sense-checking the results.
Assist Artex Fund Services with valuation reviews of their clients’ portfolios.
Support the development of actuarial models to enhance delivery efficiency.
Requirements
University degree in analytical field such as Actuarial Sciences, Math or Statistics
Nice to have: Keen interest in studying towards an actuarial qualification: FIA, ACAS, FCAS or equivalent
Member of Technical Staff, EvalsNewMagic AI · San Francisco, US
Application EngineerNewKeysight · Bangkok, Thailand
Credit AnalystNewGM Financial Canada · Burnaby, Canada
Analyst - Risk Analytics - ActuarialArthur J. Gallagher & Co. (Gallagher) · Mumbai, India