Open Supply Fashions : What Can We Decide from Obtain Patterns?


Open supply fashions have develop into a vital a part of the AI panorama.

I used to be curious concerning the developments within the open supply ecosystem, so I analyzed HuggingFace information on the highest 300 open supply fashions, each by general utilization & additionally the highest of the trending record.

Open supply fashions are ruled by open supply licenses. Much like common open supply software program, Apache & MIT dominate the licenses by mannequin depend. 76% of the highest fashions select one among these licenses. Apache is sort of twice as standard as MIT.


However the focus is bigger when viewing the share by downloads. Fashions with Apache or MIT licenses signify 92% of downloaded fashions final month.


Stability, Fb, & Microsoft prime the creator record of open supply fashions by depend. So does TheBloke, an engineer who quantizes (or compresses) open supply fashions.

However the obtain information reveals very completely different patterns.


Meta’s fashions recorded 30% of downloads, pushed by its word2vec mannequin for speech recognition. Then OpenAI & Google not far behind.

The most well-liked fashions by downloads are fashions for coaching different fashions, referred to as Fill-Masks fashions. Then speech recognition. Third is textual content classification (LLMs are excellent at this.) Textual content technology is fifth.


How about recognition? HuggingFace likes of a mannequin are fully uncorrelated to downloads with an R^2 of 0.06.

General, we will conclude extra lax licenses dominate the highest fashions. Meta, Google, Microsoft, Stability, & OpenAI are essential gamers throughout the open supply ecosystem.

Speech is the preferred end-user utility of open supply fashions by downloads within the final month, outdated by testing – which is sensible given what number of firms are constructing or testing LLMs.

Given all of the innovation within the area, in 1 / 4 or two, this information is perhaps very completely different. Who do you assume will prime the charts on the finish of 2024?


Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button