Senior ASIC Design Engineer — AI Evaluation & Benchmarks Job at Braintrust, San Francisco, CA

  • Braintrust
  • San Francisco, CA

Job Description

  • Rate: $102/hr
  • Hours: 5 hours / week
  • Experience: 10+ years
  • Location: United States | Canada + 6 more

We’re looking for an experienced chip design engineer to evaluate Mistral models on real-world semiconductor design workflows. You’ll combine hands-on engineering expertise with benchmark development and technical review to improve how AI models perform tasks across RTL development, synthesis, physical design, and tapeout.

What You’ll Do

  • Evaluate AI model performance: Assess recent Mistral models on chip design tasks, identifying errors, limitations, and opportunities to improve technical accuracy and practical usefulness.
  • Develop chip design benchmarks: Scope realistic tasks with clear requirements, appropriate difficulty levels, reference solutions, and measurable evaluation criteria.
  • Review vendor-delivered tasks: Validate tasks involving RTL coding, logic synthesis, and synthesized netlists for correctness, completeness, reproducibility, and relevance to engineering workflows.
  • Guide synthetic task generation: Provide domain expertise across the design flow, from RTL coding and verification through physical design, timing closure, and tapeout.
  • Create high-quality seed tasks: Develop original chip design problems, supporting artifacts, and reference solutions to seed synthetic task generation.
  • Define quality standards: Establish review criteria that account for functional correctness, synthesizability, timing constraints, and power, performance, and area.
  • Collaborate with AI and data teams: Translate engineering findings into actionable feedback that improves model evaluations and generated training data.

What You Bring

  • Significant hands-on experience in ASIC or SoC design, with deep expertise in RTL development and synthesis.
  • Strong proficiency in Verilog or SystemVerilog, including writing, debugging, and reviewing synthesizable RTL.
  • Experience with EDA tools for simulation, synthesis, and implementation, including interpreting reports and diagnosing design issues.
  • Working knowledge of the RTL-to-GDSII flow, including static timing analysis, physical design, timing closure, and signoff.
  • Ability to create self-contained engineering tasks with clear specifications, testbenches or validation methods, and technically sound reference solutions.
  • Strong technical judgment and attention to detail when reviewing code, netlists, constraints, and design artifacts.
  • Clear written communication and the ability to explain complex design concepts to AI researchers, engineers, and data teams.

Preferred Qualifications

  • Experience contributing to a chip design through tapeout.
  • Experience evaluating AI-generated code or developing technical benchmarks, datasets, or automated validation workflows.
  • Proficiency in Python, Tcl, or shell scripting for EDA automation and results analysis.
  • Familiarity with formal verification, equivalence checking, or open-source chip design tools.

Company: Senior ASIC Design Engineer — AI Evaluation & Benchmarks
Apply here:

Job Tags

Contract work

Similar Jobs

Basin Air and Diesel

Diesel mechanic Job at Basin Air and Diesel

 ...Job Description Job Description We are looking for a Diesel Mechanic to service stationary generators and compressors, construction equipment, and heavy-duty trucks. The role requires experience with air compressors and generators and the ability to pass a drug test... 

Microsoft Corporation

Security Researcher Job at Microsoft Corporation

 ...officeRole type: Individual ContributorTravel: Less than 25%Profession: Research, Applied, & Data SciencesDiscipline: Applied SciencesCompany:...  ...Microsofts AI Red Team where you'll emulate work alongside security experts to test for security and safety failures. We are... 

Varsity Tutors, a Nerdy Company

Genetics Tutor Instant Online Help (Remote) Job at Varsity Tutors, a Nerdy Company

 ...skilled Genetics tutor to provide immediate assistance to students remotely. Tutors can accept on-demand requests at their convenience,...  ...expertise in Genetics, and a friendly teaching approach. This entry-level position is ideal for those looking to make a difference in... 

Bucks County Estate Traders Inc

Ecommerce Product Photographer Job at Bucks County Estate Traders Inc

 ...Job Description Job Description Job Title: Ecommerce Photographer Location: Hatfield, PA (Bucks County Estate Traders Showroom)...  ...,this position requires specific availability to ensure our production goals are met daily. Operating Hours: Monday Saturday (... 

SpartanNash Associates, LLC

Starbucks Barista Job at SpartanNash Associates, LLC

As a member of the C&S Wholesale Grocers family of companies, SpartanNash is a food solutions company that delivers the ingredients for a better life. A distributor, wholesaler and retailer with a global supply chain network, SpartanNash distributes grocery and household...