The MLCommons AI Safety working group has issued a public expression of interest (EOI) for prompt generation suppliers for its v1.0 AI Safety Benchmark Suite. A full description of the EOI can be found here. Qualified and interested organizations should express interest using the submission form . Note that the submission form will not require a formal proposal, rather MLCommons will use the form to determine who to contact for exploratory calls. The submission deadline is July 19, 2024; early submissions are encouraged.
Deliverable options
Qualified organizations may express interest for one or both of the following deliverable options:
Deliverable Option 1 – Pilot Project
For organizations that wish to propose coverage of languages, hazards or personas not listed in Deliverable Option 2. This option will come with a smaller budget than Deliverable Option 2.
Deliverable Option 2 – Full Coverage Project
For organizations that wish to fully cover MLCommons’ required hazards, languages and personas. This option will come with a bigger budget than Deliverable Option 1.
See the full EOI description for more information about the deliverable options.
Who should express interest?
Through the EOI, MLCommons hopes to engage with diverse organizations that have deep expertise in different geographies, languages, disciplines, industries and hazards. MLCommons is committed to nurturing a mature and global AI safety ecosystem, and we are excited to connect and learn from potential suppliers from around the world. We hope to hear from you!
Join us
We welcome additional participation to help shape the v1.0 AI Safety benchmark suite and beyond. To contribute, please join the MLCommons AI Safety working group.
