Update README.md
Browse files
README.md
CHANGED
|
@@ -4,7 +4,7 @@ license: cc-by-nc-4.0
|
|
| 4 |
|
| 5 |
# Gemma Scope:
|
| 6 |
|
| 7 |
-
!(
|
| 8 |
|
| 9 |
This is a landing page for **Gemma Scope**, a comprehensive, open suite of sparse autoencoders for Gemma 2 9B and 2B. Sparse Autoencoders are a "microscope" of sorts that can help us break down a model’s internal activations into the underlying concepts, just as biologists use microscopes to study the individual cells of plants and animals.
|
| 10 |
|
|
@@ -14,7 +14,7 @@ This is a landing page for **Gemma Scope**, a comprehensive, open suite of spars
|
|
| 14 |
- Check out the [interactive Gemma Scope demo](https://www.neuronpedia.org/gemma-scope) made by [Neuronpedia](https://www.neuronpedia.org/).
|
| 15 |
- Check out our [Google Colab notebook tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) for how to use Gemma Scope.
|
| 16 |
- Read the Gemma Scope technical report (TODO link).
|
| 17 |
-
- Check out Mishax,
|
| 18 |
|
| 19 |
# Quick start:
|
| 20 |
|
|
|
|
| 4 |
|
| 5 |
# Gemma Scope:
|
| 6 |
|
| 7 |
+

|
| 8 |
|
| 9 |
This is a landing page for **Gemma Scope**, a comprehensive, open suite of sparse autoencoders for Gemma 2 9B and 2B. Sparse Autoencoders are a "microscope" of sorts that can help us break down a model’s internal activations into the underlying concepts, just as biologists use microscopes to study the individual cells of plants and animals.
|
| 10 |
|
|
|
|
| 14 |
- Check out the [interactive Gemma Scope demo](https://www.neuronpedia.org/gemma-scope) made by [Neuronpedia](https://www.neuronpedia.org/).
|
| 15 |
- Check out our [Google Colab notebook tutorial](https://colab.research.google.com/drive/17dQFYUYnuKnP6OwQPH9v_GSYUW5aj-Rp?ts=66a77041) for how to use Gemma Scope.
|
| 16 |
- Read the Gemma Scope technical report (TODO link).
|
| 17 |
+
- Check out [Mishax](https://github.com/google-deepmind/mishax), a GDM internal tool that we used in this projec to exposing the internal activations inside Gemma 2 models.
|
| 18 |
|
| 19 |
# Quick start:
|
| 20 |
|