✨ We just announced Composer to speed up training your models. Check us out on GitHub! ✨

All
Integrations
Engineering
Research
Launch
Methodology
More
Train Faster & Cheaper on AWS with MosaicML Composer
Engineering
by
Emily Hutson, Hagay Lupesko, Bandish Shah
on
October 24, 2022
Share

Train Faster & Cheaper on AWS with MosaicML Composer

Use Composer, our open-source training library, to reduce deep learning training time and cost on AWS. Composer makes it easy to use the latest and greatest training algorithms, composing them together to speed up training and improve model quality.
*Prices estimated on AWS p4d.24xlarge - on demand pricing

Check out the latest AWS blog post featuring Composer's capabilities!

Thanks to the AWS team (led by Olivier Cruchant) for breaking down the challenges of deep learning model training - and the benefits of our open source Composer library -  in their latest blog post. More efficient training is a superpower for enterprise data scientists, enabling them to iterate faster, reduce cost - or build higher quality models by training on more data in the same amount of time. Composer incorporates dozens of training optimization algorithms that speed up training and improve model quality. These algorithms are available via a Trainer API that makes it easy to compose (get it?) algorithms together into your model training. 

Already an AWS customer? We’ve got you covered with a tutorial. Check out a step-by-step demonstration of how you can use Composer on AWS to train ResNet-50 on the ImageNet dataset to the industry-standard 76.6% top-1 accuracy on an EC2 instance in just 27 minutes - and for less than the cost of a large pizza! Once you’re caught up on the blog post from our friends at AWS, head over to our Github site for more info on Composer and join our community today. 

‍

What’s a Rich Text element?

The rich text element allows you to create and format headings, paragraphs, blockquotes, images, and video all in one place instead of having to add and format them individually. Just double-click and easily create content.

Static and dynamic content editing

A rich text element can be used with static or dynamic content. For static content, just drop it into any page and begin editing. For dynamic content, add a rich text field to any collection and then connect a rich text element to that field in the settings panel. Voila!

How to customize formatting for each rich text

Headings, paragraphs, blockquotes, figures, images, and figure captions can all be styled after a class is added to the rich text element using the "When inside of" nested selector system.

Engineering

MosaicML StreamingDataset: Fast, Accurate Streaming of Training Data from Cloud Storage

Loading your training data becomes an escalating challenge as datasets grow bigger in size and the number of nodes scales. We built StreamingDataset to make training on large datasets from cloud storage as fast, cheap, and scalable as possible. Specially designed for multi-node, distributed training, StreamingDataset maximizes correctness guarantees, performance, and ease of use.

Mar 17, 2023
Research

MosaicBERT: Pretraining BERT from Scratch for $20

With the MosaicBERT architecture + training recipe, you can now pretrain a competitive BERT-Base model from scratch on the MosaicML platform for $20. We’ve released the pretraining and finetuning code, as well as the pretrained weights.

Mar 17, 2023
Research

Training Stable Diffusion from Scratch Costs <$160k

We wanted to know how much time (and money) it would cost to train a Stable Diffusion model from scratch using our Streaming datasets, Composer, and MosaicML platform. Our results: it would take us 79,000 A100-hours in 13 days, for a total training cost of less than $160,000. Our tooling not only reduces time and cost by 2.5x, but it is also extensible and simple to use.

Mar 8, 2023
© 2022 Mosaic ML
TermsPrivacy Policy