srowen commited on
Commit
566313b
·
verified ·
1 Parent(s): d3ca9d9

Initial revision

Browse files
Files changed (1) hide show
  1. README.md +50 -2
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- title: README
3
  emoji: 🏢
4
  colorFrom: yellow
5
  colorTo: pink
@@ -7,4 +7,52 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Databricks
3
  emoji: 🏢
4
  colorFrom: yellow
5
  colorTo: pink
 
7
  pinned: false
8
  ---
9
 
10
+ # About Us
11
+
12
+ With origins in academia and the open source community, Databricks was founded in 2013 by the original creators of Apache Spark™, Delta Lake and MLflow.
13
+ Our Data Intelligence Platform unifies data, AI and governance to make it easy for enterprises to create AI applications that understand their data.
14
+
15
+ Bolstered by the 2023 acquisition of MosaicML, the combined AI R&D teams – creators of the Dolly models and [IFT dataset](http://databricks-dolly-15k), and the
16
+ [MPT family of models](https://huggingface.co/collections/mosaicml/mpt-6564f3d9e5aac326bfa22def) –
17
+ are now known as Databricks Mosaic AI Research. We continue to use rigorous science and engineering to deliver state-of-the-art generative AI training
18
+ and inference capabilities to organizations, while enabling them to retain control, security, and ownership over their valuable data.
19
+
20
+ To get started with using models hosted on Hugging Face for training and inference on the Databricks platform,
21
+ [sign up for a free trial](https://www.databricks.com/try-databricks)!
22
+
23
+ # Resources
24
+
25
+ ## [LLM Foundry](https://github.com/mosaicml/llm-foundry/tree/main)
26
+
27
+ This repo contains code for training, finetuning, evaluating, and deploying LLMs for inference with [Composer](https://github.com/mosaicml/composer)
28
+ on the Databricks Data Intelligence Platform.
29
+
30
+ ## [Composer Library](https://github.com/mosaicml/composer)
31
+
32
+ The open source Composer library makes it easy to train models faster at the algorithmic level. It is built on top of PyTorch.
33
+ Use our collection of speedup methods in your own training loop or—for the best experience—with our Composer trainer.
34
+
35
+ ## [StreamingDataset](https://github.com/mosaicml/streaming)
36
+
37
+ Fast, accurate streaming of training data from cloud storage. We built `StreamingDataset` to make training on large datasets from cloud storage as fast,
38
+ cheap, and scalable as possible.
39
+
40
+ It’s specially designed for multi-node, distributed training for large models—maximizing correctness guarantees, performance, and ease of use.
41
+ Now, you can efficiently train anywhere, independent of your training data location. Just stream in the data you need, when you need it.
42
+ To learn more about why we built `StreamingDataset`, read our [announcement blog](https://www.databricks.com/blog/mosaicml-streamingdataset).
43
+
44
+ `StreamingDataset` is compatible with any data type, including images, text, video, and multimodal data.
45
+
46
+ With support for major cloud storage providers, and designed as a drop-in replacement for your PyTorch
47
+ [`IterableDataset`](https://pytorch.org/docs/stable/data.html#torch.utils.data.IterableDataset) class,
48
+ `StreamingDataset` seamlessly integrates into your existing training workflows.
49
+
50
+ ## [Examples Repo](https://github.com/mosaicml/examples)
51
+
52
+ This repo contains reference examples for training ML models quickly and to high accuracy. It's designed to be easily forked and modified.
53
+ It currently features the following examples:
54
+
55
+ - [ResNet-50 + ImageNet](https://github.com/mosaicml/examples#resnet-50--imagenet)
56
+ - [DeeplabV3 + ADE20k](https://github.com/mosaicml/examples#deeplabv3--ade20k)
57
+ - [GPT / Large Language Models](https://github.com/mosaicml/examples#large-language-models-llms)
58
+ - [BERT](https://github.com/mosaicml/examples#bert)