In a game-changing move, Stability AI has unveiled two cutting-edge models, Stable LM 2 1.6B and Stable Code 3B, reshaping the landscape of generative AI and code assistance.

Smaller Yet Mightier: Stable LM 2 1.6B Takes the Stage

Size becomes a pivotal factor in the world of large language models, and Stability AI, known for its stable diffusion text-to-image generative AI, introduces its latest innovation: the compact yet powerful Stable LM 2 1.6B. This marks the company’s ongoing commitment to innovation, following the recent release of Stable Code 3B.

Stable LM 2 1.6B aims to break barriers, making generative AI more accessible. With a focus on multilingual data in seven languages, including English, Spanish, German, Italian, French, Portuguese, and Dutch, the model strikes a balance between speed and performance through recent algorithmic advancements in language modeling.

Carlos Riquelme, Head of the Language Team at Stability AI, notes the trend of recent smaller models outperforming older, larger ones. He emphasizes, “Stable LM 2 1.6B performs better than some larger models that were trained a few months ago,” drawing a parallel to the evolution of technology like computers and microchips getting smaller, thinner, and better over time.

Despite its smaller size, Stability AI acknowledges potential drawbacks due to the model’s nature. Cautioning about potential issues like high hallucination rates or potential toxic language, the company places transparency and data-centricity at the core of the new model release.

Stable Code 3B Redefines AI-Assisted Software Development

In a parallel development, Stability AI introduces Stable Code 3B, a three-billion-parameter AI system aimed at automating code generation and completion. This upgraded model, with a larger context size and improved completion quality, marks a significant leap in AI-assisted software development.

Stable Code 3B, designed to run efficiently on standard hardware like laptops, challenges the notion that larger models are always superior. The model covers 18 programming languages, providing enhanced coding assistance to developers. Incorporating Rotary Position Embeddings (RoPE) for context expansion, the model exhibits the innovative Fill in the Middle (FIM) capability, automatically completing larger missing sections of code.

The field of AI-generated code has garnered attention from tech giants, and Stability AI’s new system outperforms comparable models, positioning itself as a leader in this dynamic space. With benchmarks showcasing its capabilities and increased accessibility, Stable Code 3B aims to streamline software development workflows, allowing developers to focus on more complex challenges.

A Unified Vision: Accessibility, Innovation, and Community Collaboration

Stability AI’s journey towards smaller, more powerful language models is evident in the release of StableLM Zephyr 3B in December 2023. The company emphasizes transparency by making the new models available with pre-trained and fine-tuned options, encouraging developers to explore and innovate.

Carlos Riquelme underlines the company’s commitment, stating, “Our goal is to provide more tools and artifacts for individual developers to innovate, transform, and build on top of our current model.” With both Stable LM 2 1.6B and Stable Code 3B, Stability AI positions itself as a pioneer in generative AI, offering accessible yet powerful tools for developers globally.