Role: Senior Software Engineer – LLM Evaluation Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience
Role Overview:We are hiring for one of our clients, seeking a Senior Software Engineer – LLM Evaluation to work on a full-time basis. You will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in multiple programming languages.
Key Responsibilities:• Curate code examples, build solutions, and correct code in Python, Java Script (including React JS), C/C++, Java, Rust, and Go.• Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability.• Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions against industry performance benchmarks.• Build agents that verify code quality and identify error patterns.• Hypothesize on software engineering cycle steps and evaluate model capabilities on them.
Required Skills & Qualifications:• Several years of software engineering experience, including 2+ years at a top-tier product company.• Strong expertise in building full-stack applications.• Experience with Python and Java Script, including React JS.• Proficiency in C/C++, Java, Rust, and Go.• Ability to design verification mechanisms for software engineering tasks.
More About the Opportunity:This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement of AI systems that drive measurable business impact.
Equal Opportunity Employer:We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!