Get Involved
Getting Started
Follow these five steps to become part of the MLCommons® community and get access to meetings, documents, and code.
-
Please use your organizational (e.g., corporate or academic) email account to join all mailing lists. If you do not have an organizational email address, please contact participation@mlcommons.org.
-
Associate a Google account with your email address so you can access meetings and documents. You can skip this step if your email address is provided by Google Workspace.
-
Consider becoming a Member or Affiliate of MLCommons. Some working groups require you to join as a Member or register as an Affiliate. Your organization might already be a Member; check the logos on the MLCommons homepage. Membership is free for academics. To join as a Member or register as an Affiliate, contact participation@mlcommons.org.
-
Join one or more of the working groups listed in the table below to sign up for group mailing lists, receive meeting invitations, and access shared documents and meeting minutes. Requests are manually reviewed, so please be patient.
- If you're not interested in joining one of the working groups, you can still sign up for our mailing list and access public drive resources by joining the public@mlcommons.org Google Group. (Note that personal email addresses are allowed on this mailing list.)
- If you or your organization are a Member or Affiliate, you can also access drive resources available exclusively to Members and Affiliates by joining the community@mlcommons.org Google Group. (If you have trouble accessing drive resources after following these steps, be sure to check that Google Drive is on your allow list for corporate accounts).
-
If you want to contribute code, you or your organization must sign our Contributor License Agreement (CLA). For more information regarding the CLA, see the CLA section of this page.
Join our Discord server
MLCommons uses Discord for group collaboration and communication. The invite code for our Discord server is https://discord.gg/emD2ge5EjG and the server name is “MLCommons”.
Once you have joined the server, you will need to accept the server rules, which include the MLCommons Code of Conduct. We also ask that you set your server nickname to identify your name and the company/entity you represent, e.g., John Doe (Initrode).
The Discord server is organized into many different channels, and each Working Group has its own category and channels. When you first join the Server, the onboarding wizard will ask you to select the Working Groups that interest you, then make visible the corresponding categories and channels based on your answers. If you'd like to hide or reveal channels, you can visit the "Channels & Roles" tab to change your answers or browse the available channels.
Not all channels are available to everyone. Channels corresponding to Working Groups with access restrictions require that users have the "Member" Role. Meanwhile, public channels (e.g., #general-chat) and channels corresponding to Working Groups with no access restrictions are open to anyone.
Public Calendar
The MLCommons Overview Calendar shows major deadlines and events for the current year.
The MLCommons Meeting Calendar includes all of the public MLCommons meetings and events:
Attend Events
MLCommons organizes community meetings every quarter, typically in the San Francisco Bay Area. As a global organization, we also host annual community events in the Asia-Pacific (APAC) and Europe-Middle East-Africa (EMEA) regions to reach everyone regardless of geography. The meetings are open to anyone (by joining as a MLCommons Member, registering as an Affiliate, or signing up for the public mailing list). The dates and locations are shown below. More specific information is available on the public MLCommons mailing list.
| Community Meeting Date | Location | Slides |
|---|---|---|
| Thursday, November 30, 2023 | TBA | TBD |
| Thursday, September 21, 2023 | TBA | TBD |
| Thursday, July 20, 2023 | AMD, Santa Clara | slides |
| Thursday, April 20, 2023 | VMWare, Palo Alto | slides |
| Thursday, December 8, 2022 | Intel, Santa Clara | slides |
| Thursday, September 22, 2022 | Nutanix, San Jose | slides |
| Thursday, July 14, 2022 | NVIDIA, Santa Clara | slides |
| Thursday, April 21, 2022 | Virtual | slides |
| Thursday, December 9, 2021 | Virtual | slides |
| Thursday, September 30, 2021 | Virtual | slides |
| Thursday, July 15, 2021 | Virtual | slides |
| Thursday, April 22, 2021 | Virtual | slides |
| Thursday, December 17, 2020 | Virtual | slides |
| Thursday, May 28, 2020 | Virtual | slides |
| Thursday, March 12, 2020 | Virtual | slides |
| Thursday, December 12, 2019 | Facebook, Menlo Park | slides |
| Thursday, October 10, 2019 | Samsung, San Jose | slides |
| Thursday, August 8, 2019 | Cadence, San Jose | slides |
| Thursday, June 6, 2019 | AMD, Santa Clara | slides |
| Thursday, April 4, 2019 | Synopsys, San Jose | slides |
| Thursday, February 14, 2019 | Xilinx, San Jose | slides |
During the COVID-19 pandemic, our community meetings have been converted to virtual events.
Become a Member
MLCommons is a community-driven and community-funded effort and we are proud to include a variety of Members and Affiliates from across the globe. As an open engineering consortium, Member or Affiliate status is available on a non-discriminatory basis to all organizations, corporations, academic researchers, nonprofits, government organizations, and individuals.
Membership offers several benefits
- Access to and influence on all working groups, including MLPerf™ Training and Inference, Datasets, and Best Practices
- MLPerf Training, Inference, and Mobile require Membership to submit results
- Representatives of voting Members are eligible to run for and vote in elections for the board of directors
- MLCommons Members get a voice in the direction of the organization
- All paid MLCommons Members are listed on the website
If you are interested in Membership, please contact participation@mlcommons.org.
BIS-listed entities can join MLCommons as Members and enjoy nearly all of the benefits, but cannot participate in closed activities.
Closed activities are activities and information reserved solely for members and staff, including the following:
- Non-public benchmark review process
- Inference Mobile working group
- Datasets working group
- Serving as a working group chair or on the board of directors
Become an Affiliate
Affiliates have access to all working groups and associated GitHub repositories, mailing lists, meetings, events, documents, and files, excluding closed activities (as defined above). If you or your organization is interested in becoming an Affiliate, please contact participation@mlcommons.org.
BIS-listed entities can join MLCommons as Affiliates and enjoy nearly all of the benefits, but cannot participate in closed activities.
Submit MLPerf™ Results
If you are interested in submitting MLPerf benchmark results, please join the appropriate working group. Typically, the registration deadline is several weeks in advance of submission to ensure that all submitters are aware of benchmark requirements and to provision the necessary resources.
Submitting MLPerf benchmarks requires:
- A signed CLA to enable contributing code, logs, etc. to MLCommons repos
- Membership in MLCommons OR a signed Non-member Test Agreement
- A signed trademark license agreement (either the member OR non-member version, as appropriate)
Membership is required for most benchmark working groups (e.g., Training, Inference, Mobile). Some benchmark working groups are public and have no access requirements (see the list above for examples) and non-members may submit to the benchmark by first signing a Non-member Test Agreement (found at Policies). Both the member and non-member trademark agreements are available upon request to support@mlcommons.org.
Use MLPerf Results
MLPerf is a trademark of MLCommons. The use of the MLPerf results and trademark are described in our Policies.
Sign or Get Authorized on the CLA
Generally we encourage people to become Members if they wish to contribute to MLCommons projects. However, if you are interested in contributing to one of our open source projects and do not think your organization would be a good fit as a Member, please fill out this CLA sign up form.
If your organization is already a Member of MLCommons, you can also use the CLA sign up form to request authorization to commit code in accordance with the CLA.
If you have questions about the CLA, please contact support@mlcommons.org.
Contact
We are a pretty friendly organization and easy to contact.
For any Membership or Affiliate questions, please contact participation@mlcommons.org.
For technical issues around MLCommons projects, please file GitHub issues.
For technical assistance with MLCommons infrastructure such as Google Groups, please contact support@mlcommons.org.