Pavlov's List

RL envs and data. By @chrisbarber

John Schulman: “The intros were helpful, thanks! We talked to most of them and I was impressed by most of them.” (used with permission)

DomainCodeLong HorizonEnterpriseComputer UseMLBrowserMulti-DomainSecurityFinanceAlignmentMathTool UseScienceCreative
LocationSFLondonAmsterdamWarsawBrooklynMountain ViewNYCBerkeleyDelawareLausannePalo AltoParisRemoteSan Mateo
Company DomainLocationTeam Background Active Founders & RL Leads Team Size Benchmark / Sample
Mercor Multi-Domain SFSanta Clara Thiel Fellowship, Harvard, Georgetown Brendan Foody (@BrendanFoody)Adarsh Hiremath (@adarsh_exe)Surya Midha (@suryamidha)Brendan Foody, Adarsh Hiremath, Surya Midha 250+ APEX
Handshake Multi-Domain SFNYC, Bangalore, Berlin Palantir, Meta, Scale AI Garrett Lord (@GarrettLord)Ben Christensen (@benmchristensen)Scott Ringwelski (@scottringwelski)Paco Guzmán (@guzmanhe)Sahil Bhaiwala (@Sbhaiwala03)Jack Bratches (@JBratches)Nishant RankaYang ZhaoGarrett Lord, Ben Christensen, Scott RingwelskiRL envs: Paco Guzmán, Sahil Bhaiwala, Jack Bratches, Nishant Ranka, Yang Zhao 250+ Gandalf the Grader
Scale Multi-Domain Code SFNYC, DC, London Stanford, Coinbase, YC Chetan Rane (@the_chet2an)RL envs: Chetan Rane 250+ SWE-bench Pro
Turing Code SFPalo Alto, Gurugram Stanford, Rover, Yahoo Jonathan Siddharth (@jonsid)Vijay KrishnanJonathan Siddharth, Vijay Krishnan 250+ VLMBench
Toloka Multi-Domain AmsterdamBelgrade Yandex, Microsoft, McKinsey Olga Megorskaya (@MegorskayaOlga)Olga Megorskaya 250+ Toloka Arena
Surge Multi-Domain SFNYC, Seattle Google, Meta, Twitter Edwin Chen (@echen)Nick Heiner (@nickheiner)Edwin ChenRL envs: Nick Heiner 101-250 CoreCraft
Snorkel Multi-Domain Code SFNYC Stanford, UW, Meta Alex Ratner (@ajratner)Braden Hancock (@bradenjhancock)Christopher RéParoma Varma (@paroma_varma)Henry Ehrenberg (@henryehrenberg)Vincent Sunn Chen (@vincentsunnchen)Frederic Sala (@fredsala)Alex Ratner, Braden Hancock, Christopher Ré, Paroma Varma, Henry EhrenbergRL envs: Vincent Sunn Chen, Frederic Sala 101-250 Senior SWE-Bench
micro1 Multi-Domain SF Stanford, Berkeley Ali Ansari (@aliansarinik)Ali Ansari 101-250 Realm
AfterQuery Multi-Domain SFNYC, Seattle Wharton, Penn, UBC Carlos Georgescu (@CarlosGeorgescu)Spencer Mateega (@spencermateega)Carlos Georgescu, Spencer Mateega 51-100 AppBench
Latch Science SF Berkeley, Google, Asimov Alfredo Andere (@AlfredoAndere)Kenny Workman (@kenbwork)Kyle Giffin (@kylegiff)Alfredo Andere, Kenny Workman, Kyle Giffin 51-100 benchmarks.bio
Patronus AI Multi-Domain Code SF Meta AI, Google, Amazon Anand Kannappan (@anandnk24)Rebecca Qian (@rebeccatqian)Anand Kannappan, Rebecca Qian 51-100 FinanceBench, TRAIL
Datacurve Code SF Waterloo Serena Ge (@serenaa_ge)Charley Lee (@charleyslee)Serena Ge, Charley Lee 26-50 DeepSWE
Halluminate Finance Enterprise SF Capital One, Meta, Cornell Jerry Wu (@Jerr_Wu)Wyatt Marshall (@wgm752)Jerry Wu, Wyatt Marshall 26-50 WebBench
Mechanize Code SF Epoch AI Guive Assadi (@GuiveAssadi)Tamay Besiroglu (@tamaybes)Ege Erdil (@EgeErdil2)Matthew Barnett (@MatthewJBar)Guive Assadi, Tamay Besiroglu, Ege Erdil, Matthew Barnett 26-50 GBA Eval
Pareto Multi-Domain Tool Use SF Stanford, Scale, Turing Phoebe Yao (@phoebeyao)Mark Whiting (@MarkWhiting)Youssef ElhadyJoe CrawleyPhoebe YaoRL envs: Mark Whiting, Youssef Elhady, Joe Crawley 26-50 Leap, Attune
Proximal Code SFBangalore Prime Intellect, Cursor Justus Mattern (@MatternJustus)Navid Pour (@navidkpr)Calvin Chen (@calvinchen)Justus Mattern, Navid Pour, Calvin Chen 26-50 FrontierSWE
Aptura Finance Enterprise LondonSF Lazard, McKinsey, EF Chirag Modi (@modic123)Chirag Modi 11-25 SpreadsheetBench 2
Bespoke Labs Code Mountain ViewMenlo Park, Bangalore, SF Google DeepMind, UC Berkeley Mahesh Sathiamoorthy (@madiator)Alex Dimakis (@AlexGDimakis)Mahesh Sathiamoorthy, Alex Dimakis 11-25 OpenThoughts
Collinear Enterprise Long Horizon Mountain ViewSunnyvale Hugging Face, Salesforce, Stanford Nazneen Rajani (@nazneenrajani)Soumyadeep Bakshi (@soumyadeepb_)Nazneen Rajani, Soumyadeep Bakshi 11-25 Curator Evals
Emulated ML Science SF AWS, DeepMind, Prime Intellect Joseph Wang (@_josephwang_)Sid Patllollu (@sidpatl)Joseph Wang, Sid Patllollu 11-25 SWE, Autoresearch
Quesma Security Warsaw Elastic, Sumo Logic, Dynatrace Jacek Migdal (@jakozaur)Jacek Migdal 11-25 BinaryAudit
ReasonCore Science Code SF Turing, Aera Technology, Oracle Geoff WolfeAnshuman LallSatish VutukuruGeoff Wolfe, Anshuman Lall, Satish Vutukuru 11-25 Benchmarks
Abundant Code SF Waymo, Google, Mercor Jesse HuKe Huang (@kehuangsf)Meji Abidoye (@meji_abidoye)Jesse Hu, Ke Huang, Meji Abidoye 1-10 SWE-Marathon
Aviro Code ML SF YC, Princeton, Georgia Tech Ayush Karupakula (@AyushKarupakula)Aarush Kukreja (@aarush_kukreja)Ayush Karupakula, Aarush Kukreja 1-10 C⁴
BenchFlow Enterprise Browser SF Berkeley, Tesla Xiangyi Li (@xdotli)Xiangyi Li 1-10 SkillsBench
Cua Code Computer Use SF Microsoft, Twitter Francesco Bonacci (@francedot)Dillon DuPont (@ddupont808)Francesco Bonacci, Dillon DuPont 1-10 Cua-Bench
EdotEnv Long Horizon ML SF G-Research, Etched, ETH Zurich Rui Wang (@RRicefan)Michael Zhang (@Michaelz1914)Rui Wang, Michael Zhang 1-10 Long-Horizon Planning
General Reasoning Finance LondonSF Meta, Conjecture, Aleph Alpha Ross Taylor (@rosstaylor90)Chengxi Taylor (@ChengxiTaylor)Kip ParkerThomas GradyRoss Taylor, Chengxi Taylor, Kip Parker, Thomas Grady 1-10 OpenReward
Markov Computer Use Tool Use SF YC, IIT Madras Dev Mandal (@DevvMandal)Harish Ashok (@habril27)Dev Mandal, Harish Ashok 1-10 CUA data, AutoCAD-Bench
Metaphi Code Enterprise SFNYC Waymo, Nuro, Netflix Abhishek Chandwani (@abhi_chandwani)Ishan Gupta (@Ishan345)Abhishek Chandwani, Ishan Gupta 1-10 CREW
Normal Hardware Engineering SF Cohere, Notion, Fuse Hudzah (@hudzah)Anson Yu (@ansonyuu)Hudzah, Anson Yu 1-10 CAD Arena
pre.dev Code Long Horizon Delaware Penn M&T, Wharton Arjun Raj Jain (@ArjunRajJain)Adam ElkassasArjun Raj Jain, Adam Elkassas 1-10 TB3 results
Refresh Code Computer Use SF Uber, Amazon Christopher Settles (@never_settles_)Erik Quintanilla (@erikqu_)Christopher Settles, Erik Quintanilla 1-10 BlenderBench
Tacit Labs Science Long Horizon SF MosaicML, MSR, EF Nicole Fitzgerald (@ninklefitz)Anne Marie Droste (@AmDroste)Nicole Fitzgerald, Anne Marie Droste 1-10 LifeSciBench
Ulam Math WarsawLondon Oxford Przemek Chojecki (@prz_chojecki)Przemek Chojecki 1-10 RLVR Trajectories
Vmax ML SFNYC UCL Matthew Sargent (@matthewjsargent)Augustine Mavor-Parker (@MavorParker)Matthew Sargent, Augustine Mavor-Parker 1-10 unix-ctf
Uber AI Audio SF Scale AI, Turing, Harvard Natesh Pillai (@Bayesprof)Key people: Natesh Pillai 250+
Originator Computer Use Code LondonParis Google, Dataform, Pareto Holdings Ben Cambier (@BenjaminCambier)Lewis Hemens (@lewishemens)Ben Cambier, Lewis Hemens 101-250
Fleet Multi-Domain Enterprise SFNYC Mercor, Anthropic, MSL Nicolai Ouporov (@nicoup)Andrew Zhou (@andrewthezhou)Nicolai Ouporov, Andrew Zhou 51-100
Parsewave Long Horizon SFRemote Meta, Red Hat Ivan KudryavtsevLouis Pan (@shaped)Louka Ewington-PitsosIvan Kudryavtsev, Louis Pan, Louka Ewington-Pitsos 51-100
Wirestock Creative SF Utah State, MIT Mikayel Khachatryan (@MikayelK)Ashot Mnatsakanyan (@AshotMna)Hovhannes Kuloghlyan (@h0vhannes)Mikayel Khachatryan, Ashot Mnatsakanyan, Hovhannes Kuloghlyan 51-100
Deeptune Acquired Code Computer Use NYC Hebbia Tim Lupo (@timlupo)Tim Lupo 26-50
Huzzle Labs Long Horizon Code LondonBerlin, SF Turing Ingmar Klein (@ingmariusX)Amit Choudhary (@amit_1992)Ingmar Klein, Amit Choudhary 26-50
Verita AI Creative SFVancouver HRT, Jane Street, Mercor Rithika Kacham (@rithika_ka)Rishi Kalakuntla (@rishiinsf)Rithika Kacham, Rishi Kalakuntla 26-50
ARIMLABS Security Long Horizon Warsaw Akamai Mykyta Mudryi (@mykytamudryi)Markiian Chaklosh (@markiyanch)Mykyta Mudryi, Markiian Chaklosh 11-25
Chakra Labs Computer Use Tool Use Brooklyn Microsoft, L/S, Snap Nirmal Krishnan (@nirmal_dist)Alex Fung (@alexfung)Nirmal Krishnan, Alex Fung 11-25
dmodel ML Alignment SF OpenAI, Google Brain, EleutherAI Anish Tondwalkar (@dlbydq)Daniel Moon (@dmooooon)Anish Tondwalkar, Daniel Moon 11-25
HUD Long Horizon Code SFSingapore METR, AWS, Hume Lorenss Martinsons (@seeklis)Parth Patel (@parth220)Jay Ram (@jayendra_ram)Lorenss Martinsons, Parth Patel, Jay Ram 11-25
Idler Code SF Meta, Microsoft, Cornell Ivan Chub (@chubivan)Nalu Concepcion (@naluconcepcion)Tony Goss (@cha0sg0d_)Ivan Chub, Nalu Concepcion, Tony Goss 11-25
Incalmo Security San Mateo CMU, MSR, RSAC Labs Brian SingerMark DongOmer AkgulAo LiBrian Singer, Mark DongRL envs: Omer Akgul, Ao Li 11-25
Preference Model ML Code SFToronto, Seattle Anthropic, Stripe, Datology Jennifer ZhouNing Cao (@Ning_Catsnail)Jennifer Zhou, Ning Cao 11-25
Symbal Code Enterprise SF Meta AI, General Catalyst, Deeptune Krishay MukhijaPranay ManochaAkash JainKrishay Mukhija, Pranay Manocha, Akash Jain 11-25
Taste Labs Creative NYC Exa, Palantir, Mercado Libre Thais Castello Branco (@thaiscbranco_)Thais Castello Branco 11-25
Align AI Enterprise Code NYC Meta, Apple, Cornell Spandana GovindgariGirish KumarSpandana Govindgari, Girish Kumar 1-10
Andromede Long Horizon Lausanne MIT, EPFL Alexandre Sallinen (@alexsallinen)Guillaume AllegreAlexandre Sallinen, Guillaume Allegre 1-10
Anthromind Medical Long Horizon SF Google, Forward Health Pratik Karki (@ai_evals)Mannat Sandhu (@mannatsan)Pratik Karki, Mannat Sandhu 1-10
Diffuse Labs ML Long Horizon Palo AltoSF a16z, CMU Daljeet Virdi (@daljeet_v)Tejpal Singh (@tsv650)Daljeet Virdi, Tejpal Singh 1-10
Dissei Finance London Warwick, Goldman Sachs, HBS Tudor PopescuJai TrivediEddy BTudor Popescu, Jai Trivedi, Eddy B 1-10
Exabite Code Remote Stanford, MIT, Magic Alana XiangAlana Xiang 1-10
Good Start Labs Games Long Horizon BrooklynNYC, Toronto Waterloo, Every, Amazon Robotics Alex Duffy (@alxai_)Tyler Marques (@tyler_marques)Alex Duffy, Tyler Marques 1-10
Hillclimb Math SF DeepMind, Base Jun Park (@jparkjmc)Ibrakhim Ustelbay (@agithief)Jun Park, Ibrakhim Ustelbay 1-10
Ooak Data Enterprise Paris Samsung, GoPuff, YC Thomas Aubry (@ThomAub)Pierre-Louis Vouteau (@PLouisV)Grégoire Lamy (@adeRL_g)Thomas Aubry, Pierre-Louis Vouteau, Grégoire Lamy 1-10
Phinity Chip Design SFPalo Alto NVIDIA, AWS, Stanford Sonya Jin (@sonyashijin)Aadi Nashikkar (@aadi_nash)Sonya Jin, Aadi Nashikkar 1-10
Plato Browser Enterprise SF MultiOn, Waterloo, Georgia Tech Rob Farlow (@RobFarlow)Pranav Putta (@pranav__putta)Rob Farlow, Pranav Putta 1-10
Rise Data Labs Enterprise NYC Wharton Vivian ChenVivian Chen 1-10
Sepal AI Acquired Science SF Turing, Bain, McKinsey Robi Lin (@robi_lin)Kat Hu (@KatQHu1)Robi Lin, Kat Hu 1-10
Theta Enterprise SF DeepSilicon, Cornell, MultiOn Rayan Garg (@RayanGarg)Tanmay Sharma (@tsha444)Gurvir Singh (@_gurvir_)Rayan Garg, Tanmay Sharma, Gurvir Singh 1-10
Trajectory Labs Alignment BerkeleyToronto METR, GovAI, 80000 Hours Peter McIntyre (@pmcntyr)Ben WestPeter McIntyre, Ben West 1-10
Vetto AI Code Computer Use SFSão Paulo, London DeepMind, Meta, ITA José André NunesRodrigo Schmidt (@rodrigo_schmidt)Lucas SmairaGabriel AlbuquerqueRoberta AntunesJosé André Nunes, Rodrigo Schmidt, Lucas Smaira, Gabriel Albuquerque, Roberta Antunes 1-10