🚀 Our MPT-7B family of open-source models is trending on the Hugging Face Hub! Take a look at our blog post to learn more. 🚀

✨ We’ve just launched our Inference service. Learn more in our blog post ✨

All
Integrations
Engineering
Research
Launch
Methodology
More
Cloudflare R2 and MosaicML: Train LLMs on Any Compute with Zero Switching Costs
Engineering
by
Abhinav Venigalla
on
May 23, 2023
Share

Cloudflare R2 and MosaicML: Train LLMs on Any Compute with Zero Switching Costs

Together, Cloudflare and MosaicML give users the freedom to train LLMs on any compute, anywhere in the world, for faster, cheaper training runs without vendor lock-in.
Read the complete blog post to learn more!

Building generative AI models requires massive compute AND data storage infrastructure. Training huge datasets means that terabytes of data must be read in parallel by thousands of processes. In addition, model checkpoints need to be saved frequently throughout a training run, and these checkpoints alone can be hundreds of gigabytes in size.

In a recent blog post, Cloudflare and MosaicML engineers discuss how their tools work together to address these challenges. MosaicML’s open source StreamingDataset and Composer libraries let users easily stream in training data and read/write model checkpoints back to Cloudflare R2. And thanks to R2’s zero-egress pricing and MosaicML’s cloud-agnostic platform, users can start/stop/move/resize jobs in response to GPU availability and prices across compute providers, without paying any data transfer fees. By eliminating egress fees, R2’s storage is an exceptionally cost-effective complement to MosaicML training, providing maximum autonomy and control.

What’s a Rich Text element?

The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Just double-click and easily create content.

Static and dynamic content editing

A rich text element can be used with static or dynamic content. For static content, just drop it into any page and begin editing. For dynamic content, add a rich text field to any collection and then connect a rich text element to that field in the settings panel. Voila!

How to customize formatting for each rich text

Headings, paragraphs, blockquotes, figures, images, and figure captions can all be styled after a class is added to the rich text element using the "When inside of" nested selector system.

Research

Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs

Introducing MPT-7B, the latest entry in our MosaicML Foundation Series. MPT-7B is a transformer trained from scratch on 1T tokens of text and code. It is open source, available for commercial use, and matches the quality of LLaMA-7B. MPT-7B was trained on the MosaicML platform in 9.5 days with zero human intervention at a cost of ~$200k.

May 26, 2023
Engineering

Train and Deploy Generative AI Faster with MosaicML and Oracle

Generative AI models have taken the world by storm—but their use in enterprise environments is still limited. Why? This blog post explains the obstacles to adoption and discusses why the MosaicML platform running on Oracle Cloud Infrastructure (OCI) is the best solution for enterprises that want to operationalize generative AI.

May 16, 2023
Launch

MosaicML Inference: Secure, Private, and Affordable Deployment for Large Models

We’re releasing a fully managed inference service to make deploying machine learning models as easy as possible. You can query off-the-shelf models with our Starter tier or securely deploy in-house models in your own environment with our Enterprise tier. By using MosaicML for both training and deployment, you can easily turn your data into production-grade AI services — often at a fraction of the cost of alternatives — without compromising data privacy.

May 3, 2023
© 2022 Mosaic ML
TermsPrivacy Policy