ariangoog's picture
Update README.md with self-link QR code (#2)
7dbe222 verified
---
license: gemma
base_model: google/gemma-3-1b-pt
pipeline_tag: text-generation
tags:
- chat
extra_gated_heading: Access gemma-3-1b-pt on Hugging Face
extra_gated_prompt: >-
To access gemma-3-1b-pt on Hugging Face, you are required to review and agree
to the gemma license. To do this, please ensure you are logged in to
Hugging Face and click below. Requests are processed immediately.
extra_gated_button_content: Acknowledge licensed
---
# litert-community/gemma3-1b-ft-text-to-sql
This model is generated using LoRA fine-tuning to train
[google/gemma-3-1b-pt](https://huggingface.co/google/gemma-3-1b-pt) with the
[philschmid/gretel-synthetic-text-to-sql](https://huggingface.co/datasets/philschmid/gretel-synthetic-text-to-sql)
dataset. Artifacts include `.tflite` and `.task` files that can be used to
run on mobile devices.
[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.sandbox.google.com/github/google-ai-edge/mediapipe-samples/blob/main/codelabs/litert_inference/Gemma3_1B_Fine_Tuning_text_to_sql.ipynb)
<img width="200" height="200" alt="Self-link QR code" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAASwAAAEsCAYAAAB5fY51AAAAAXNSR0IArs4c6QAAIABJREFUeF7tneF6G7kOQ7fv/9B7P7u9dcYZSTwYSBpn0b+lKBIEIUp2kl///PPPv/98wL9//z0P89evXx8Q/e8QnTlQXy37FngtXKmfXnHoHtSe5taL1ZW3KwclN8qZOzbWo9sjWIsq4yQM9UUbbnZjPSCne1B7palbayh+dO/Z/t0H5qKW+bZNBGsh8lRklBN/dlO7GiuCdayuC9fejcPJv4Vtc9gqgrUQeSdhqC/aEC7hy5XwiMBsXCNYCxvaOVHcJOxDGFRknHhEsF5oKu+eFL9cCed0YCasObieeo1gXZs2XNNJBKtWh4WtUd6qKViuE6UcyR9DSkplBHbFNPuBtvfOQ3OgYumyd75V0ZypfY/zisid7U9xpTnsnMpdsfawjmAVUKZkdYo93ZuKqOuAUJp9Z/MSMdl5cBToWTaheDt5XA6y8+nxsw6trzXcLVgK9iM5Vw5UNFz77mwUincEq9aSFNea15oV3dvJ41qEv60yYRG0TmwjWC9Q6ESWK+GRUFQ0LlL3sJzuHcEqoE8bIm9YBVCFb9k7ye2saS1bzUqZEulOFFfqP29YTsQKvpzkdp0QmbAyYVEOtKgewRqLgPVKuKtwSqHpGipwVFzHpfpusWKPs7hcdVbeEmnONFZaZ6Vus9fQnHt1mI23U7zxo7sC1FnALjFRroS0QC3AXX565F6xRwRrtrz4/St9uKLnSKY0nud7KP2UUAEqgkXKeLSNYL3wUAhOuKdXaf1KpQ8pftSeoqD4j2B9QZleFVaIyYo9MmHRVttvH8F6q4GifqSM1D+1d97ZcyUklf1uO/sgoM1L47mW/ZzVNGdnPyh7k0k3j+5vaLmmFpefvGFduwbTBopgrcW7xW9lCPn4K+HOZnc1CvXTy9nVjCvE2DV7rIiV7uGqKW1qpf6fktuPeHSPYB0RUAhL3rBc/l1i9SRx49dkO2Ole0SwxhWmYhzBGmPataCkVApEQ3Q1KW1QGqfTfkWsdA/KDde1San/p+QWwbrYNZSUEayLgDeW04ZToqB7UG5EsF4I/OhH91wJcyWkYhLByqM75gCdNlaMujQJeorSnGk8D3sFp7xhjZGmoki5kQkrE9aSx1jS7JSUyvQ4br3aROZqOBpPT3RpTC7xVnKgsTq5QeP9FDHOGxatbNGeklVpLLoHbQiX/yJkBzPXJKrgqsTrOLRofVxxPkUAfsrq4oZS53wPy1n5P75oQZXGonvQhnD5V+BViHy2j4KrEm8ES0NNqXMES8O6u4o2u9JYdI8I1oRCd1zOro8zm0xYBTSpujqbWvFVSOmvCSWrEg/dI4JFKnjddnZ9rkf48hDBKqAZwXqBFME6EoZyg4pxgZ6XTSJYYwiVOuMr4TiMaxZOtVeEgETvitUZJ20USpo7xtqqGcWiV3uKE+GRYruiDs49SI7WL46SjRVblwg89p4NuCtWZ5y0SWkj3jHWCJbSafqV8Npu49URrDFGkkUES4Jt2VsfFe9MWLWr+bWqj1dHsMYYSRYRLAm2CNY12J6rV0y6zj1IyhEsghawjWABsE5M6QREG4j6z4SVCQsz2iUC7lPoLBFXrLQRe6DSJs0bVo2iFKeaV91qBWece5BMpQmLbLDCViEMXXM3+57ozhZLl//kcOwOF66Uq0odVvQ13aP5tQbqaLb9igLRPWbbKySbHRP1nxwiWE5tiGB9QZM242z7NPvnNvtsblD/CpecQuPyFcGKYJ1yyXV1URqFNuNs+/9qDi6RcfqJYEWwIlh/EOg99s4Wxdn+FdF1Co3LVwQrghXBimC59GS6n1//7vrs0pQa/Ri/d9K0QqLXI+qnB8Xs8lD8nPFQXKn9zjrswlWZEk2tuMRNBKsA8yc1SiGdg8muxnoEQXGl9hGsIwLOw4byzGUfwSog+UmNUkgngtX4lcDOSXfXQZAJi3bAYntKjFwJjwWi+DlPaXoQUPtMWJmwFsvReDvacBGsCNZOzrQY7ToIMmGNNWOrxU7yUZKtiJUWg8ZEc+7FQycmap8JKxNW86GUNsqK753Mjsnln/rpPVgrvj5lDRVLl8D18HbFRCcvetA4azw75+4hR7/W4AIqgnWNQq46XIti7WpXo1A/Eaxrk5qTq/hTQtfmEaxrze6qw7Uo1q6mQpMJa059XHVQootgfUGNiigFnBZaef+hMX2SPcUvgjWnuq46KNFFsCJYCm+2rHE1CvWTK2GuhM3fSU1PRefVKBPWFh0qb0qFhnJJmWhdMeXRvUaDTFiZsGpMuYGVSxyon0xYP3DCck0n1M9O8tEeVqZBigeNiZ7sLXvlC4sKHmf7uzDqcYlOa7Nzc9W5J8aUGzRnqXddX2uYTRpKmBXjPSUNLejDvwtXGislUwTriLBSayLGtJ5KP0SwCijTBqWN5RzvC+kcTBQSUzxoTJSUmbBq1yOl1hGsMXttb1iuxqJ+IljjIisWFNdMWJmwqEhTjj2HjVwJX0RTACRiQAuaK2ENXXrIKVMlfZJQap0Ja1zvCNYXjCJYunhnwsqERUVa6bemYNHNx9p47e4vJSf8ojZyyrlO3Z2fTrmmk1796R601i6uKnWg05qLM7TflPrQPVbkFsEqVMXVcLSgygcEtHlpbgW4vpnQPSJYLwhpPZ31ob4ov5XcIliFqrgajhY0glUoTud3w9dW167BtLlmc4bmlgnrImKugvbCoCTbNd4rVxGKnys3pew01kxYmbBaPMuEVehAV8Nlwqo9TEewIlgRrIIwuaYQl8DlSlgr2uxJuleHXZypIVOzogdEU0waH3LRfujemlrfw6IkoEkr08ZZIjs/TneRtUarmpWrDityo7HWEBhPJ8q+s/mqxET7geJHhYbmQDXmeXBEsGgZx/a00GOPdYvZpHHmRmOto/Db0iUyTl/OmCJYXxCg6kfJ5ypcJqwjbV11yIR1RGA2X2nd6LWMiv3Dnh5ONAeqMZmwlCoW1tBCF1yWTWaTxpkbjbUMwh9Dl8hkwlor3r0650pIu6Bg72zqwnYHEyoC9JRz5kZjpVhEsChitWndhSvlXiasa/VsrnY2NQ2RigAljTM3GivFwtVYmbBuNGE9rqpnRHARk5KSNhAlce9uTn3RWBVM6RpqT3Om9ew1O92b2iux0j1a9lQsKZeUOF3coLg6c/sVwVJK/3sNLYRCGLqG2tPsKVkVnGhMLXslVtfeEawXkrRPejWIYF1gKC2EIiZ0DbWn6SsiQHGiMUWwaoi5uEE54Kx/BKtW61MrWgiFMHQNtafpU7JmwjoiPLs+vXq69qYcoH2SCesNAQo4faegJ77zu2QuUtIcuiQz/V6yFeJK96DcmF2fCNYbAlQtqThQ/wrBaEyUlLTZI1hKFcdrXHUe7/TdIm9Yk96w6I/m0BPCZe8kjeLrbA1tCKcYU1ydIkrxo7FSexqP055ygB5+FItePE7+kX6g+3ZziGDp9KVkpYXbOd7vjJU2qV7B6yspByJYY8wjWGOMJAtK1p0ikAlLKvFwEeVABGsIafNnGB8r8Y/m0NPPZT9Os/6OoPgiIzAlpRIPxTWCpaA8XhPBemE0m5MRrDEfuxaUrJmwjnDe8WGaUoJygB5mVATyhvWGsAtASlZKpKcaT/44nZLVGQ+tQyYshUHjNZQDEaxrmOIr4Xi7moWr4Wq7Ha1mk4zGpMTjEj+6t/OgoTlQzlD7Xt1m40SxoBx72NMc6B4rcohg0ap8sXcVSCHSrr0jWDXCUJxc9XSKbi3Tl9WKHCJYtCoRrFPEVogunZiovbPZI1gXGquzNIJ1AVfXibKi2ekbluutpQcvxY8KELWPYF1ohgVvxo/oIlgXakQbziUaz8KZPlCgYkknhwhW7f3UVU+n6NLWWJFDBItWJVfCXAkLnKHCvqLZ6eFUSPNgsiKHbYJFpw0nGPSqMNueEsNpT3NT9qaN4qw1iZfGqUy6K/B29RaN1WXfncrpzxISAii2NOkVe9CYqL2Sg2vNilipEESwXNW9dh2l3HDZR7DeEHABe8exn1KdYkH9P+wjWC/UVuCdCUthqbhmRUHpHrPtRagsy2huyqYRrAjWGW8oL55X8FwJX1C6JqYVIqAIByGN81pGiencm+BE48wb1pwrZ66EuRI2ObBCXKkQRLCIzNZtaa132XcFq/Vnvuow/LbclVyP3HeMiUw5tAbdQsPvba0QGVof19uME1eXL4oFrY8yDbrwprH2err5V3NoIVyAu65ldxXRCJb/PYdyj3J7hT3NgYpABOsDrlkuEjhFNIIVwSIcoNxzTtmZsL4gMFtMMmEd6UbfhegJTv0r9XE10IqJie7h6ocIVhF5F+D0RMkbVq1AVFAiWDVcXVau/olgFSviAjyCVQQcmkWwIGCLzV39E8EqFs4FeASrCDg0i2BBwBabu/ongnXzx/Xe1eWOTUoeXB+2TgF39CC9KvZycMTTewuj/lc8L7Riolyl73lOIaPiao2Vfg+LBrvLXmkU2owrSBbBGssOrZsiGi4eK3uPEXhZKFhQHlMsIlhfEMiEdaQDJR9pBnWauWNMZ3lnwqqxIYJVECA6aWTCqpGPWq04wVfEFMF6IUAPlAhWBKvZo1SoKflWiMMdY4pgRbBOuU/V2GWfCYtKUc0+E1btCk5xcok63dfZJzQHKdbZv16GClCtbe79yEhzVt7hlGKTqYL6/6T3H1qfHiddvijetE+cwtTae8VtYPrvw3IV1PpJg+k3F7gKFME6Vpc2r+tkp356H0JQXzTnCNYbAhRwKiiz/fcKSvemouuy752KLoJT0aWnq9LUNLfZ9cyEVZNHyiVat2c/5Eo4LoZLgGhBI1jj2jivOkoDUW7Qg72GQM2K5uc6OFwYRbBqdd72ywkjWLUCuRqR+lGmxwjWCwEF70xYhZ6gJ4TLPoJVKI7wV7BpfXIlvFYHJ95NwaqFOFZLOlYqbyT01FKUneDhLBDZd+eJ78SU4kc5psTq2oPm5qp/z4+Cx5k/ihHNrXslpM6U9xmyhwLqbHLcTSgjWDVGOblED9jZnFREQ8EjgjXgmgLqbHJEsMYTdk1Cjla0brRJnVyKYL0QoHVQuJEroYLaYA1tOGcIrr0p+RQRcAn+ilhde7jqQ7HLlfANgVwJxyeNs6kpYenergZVxJg29YpYXXvQ3Ch+NM7nuxD8IjXlHs2hK66t72HRTSJYESzKGUp8F8eUBqVCQGNVYnK9I+3cm3Km+XcJaYHwxgtU3VWI2Y2lxOk6qWmdaSMqJzjNjeZAubriOkVjohg9/CtrHKJI+d2rZwSLMuWLPSUAte+F5vJFmz2CdawKbcYLdDssVeqvrIlg/UHAVeiuGpumuExYLwQiWBEs1yFH++o5rbd+pzsNip4cEayxCGTCqonDbK7mSnhEgOJNez1XQqqmRXs6YlP7CFYEi04hPXFw8S+CVRQIep+myk7DoASg9hGsCFYE640D9M98uZqa+nGKDz0hWrHS9xxqr1xFXLnRnGk9d4qxwiWKK92D+lfwvmNMNI/mGxZ1RE8C6p+CrTSEKyY6SSlkdYofydtZB8oZujetg5MzrlhJbUa2d4xpFPP7/0ewKGJf7KloUPtMWLUr4Wzhe/inh8odxeGOMdH2i2BRxCJYFxCrLXVNRi4/Eaxa3VZYRbAuoEwnJmqfCSsT1gV6fluaCauAJh2lWy4p2M73CBoTPdkVjJziVyjjXxNnHWZf5WgdnJyhOCkcIHV72N4xJpwD/eFnmjQNyGnvIiz1s4J8FKdPqhvNbUV9KH4uDtCDicZJsVZE3RkT/n1Yzs2dYJ35okR2nfgusjrx+aS60bxpnZX6UPyUPc7yjmC9PQtkwhq3x4qGGEdxzYI23LXd1q5eUR+KXwTrxQGKXY89mbAKvbWiIQphXDJxkuZSIBMWr6gPxS+CFcHCVKdEzpUQQ3yLBbTOiphEsMalpnUYe/xukQmrgBothNIQhTAumdCGu7TZ4sUr6kPxc3Egb1gX37BaXLxbQR9x7iKNC6Ne39MmveP0SJvRpYPKvrv47eTS3fpByQ1PWMomZ2tmgxfBqrU3FT5X3R7RKcJRy6pvpewbwRq/Sbm40cM6glXoAIXgZ24p6TNhFYojmCj1pLVzNa9rQLjjAa7kFsEqEF4heARrDKwL1/FOb+8gjV+d3ROZCFYmLMqzU/sekVynnKuxKOkzYVko8s2JUk9aOxf3lCmEvldSlBX8yB65EhK0TmxdBaKkj2BdLFxjuVJPWrsIll67rmDN/iMUlBwue6XZKcT/xVjpI33v7YTiR6eN2aLR4wsVOMq9nXVw5abkMP2v5lBSuuwjWNfebZx1oMSkQkNjpeKg2Luaml7vlCcSip8rN8qLBxYRLIWNf9asKDRtXtcU4syNEpPmTGO9UPLyUldTR7DeDt5cCcscvPx4q5CYNm8E64WACzuFIUqtyT70EHBezV25KTlkwiIsebOlJ7tSaFfTuWJVSEbX0JxpbhdKXl6q1LrsvPNTHLkSEhRPbCmZXPZ5w8obFhW+i1Q/LI9gjdGkB1nesMaYdi3+i+KqkIyuoUJD63Cx7KXlEawxTJQXkmC5CkFJSd9mxnB9t6Ax3Q2LZ0GFb3GfYeXy06vD7D1ofWj9nbm5sFCuhLRXVsTa7Hf66E5J0NrYRQ5XPL1Hydli6cIiglW7Bs/mpFKHFSLg4tmKWCNYhWOEFtQllnRf58lOxfiOsdIcIliFZuiYRLAu4OcSjUxYtekkglUjK21qaq+ItKt2K2LNhFXgGS2oSyzpvpmwCsXc/Hf4aFNT+wjWGwLKC36NRr+tXE3qEg0lJtfeLiyUtxNK/DvGSnPIlZB06nfbFeLarGnrz3y5mvEaNNdWO5uLREILugLr2QcQwWdkS2N12Y/iOvt/WjvKyTtyieLkyvl5IEewKPxj+zuSjDb1OMt5FjRWl72SUQRrjFoEa4yR9dpZ3O6vWQSLIna0dwkQrYMSdQRrjFoEa4xRBOsNIyoCRYinmNFYXfZKMhGsMWoRrDFGEawIlu1b/z26RbDGzRjBGmMUwYpgRbCKfTLbzCpY9EdzZidH/Ss/O0VPxVZMK64irncYmjMlGa3bp9lT/HZyprU35dIu++5EG8HSWyeCpWP3aSsjWK+KuXivYDr9F/jNJmYmrBrClByZsI64UvwyYekClwnrDYFPIh8dy+l1gDZWTR5/ntUncYZyYPbERP1HsCJYzQfoCFZNXCNY+sQUwfrCsVwJ5zRcroS5EtLp3mW/ZMKiJ5BTdWstO7aaHdNs/48MqdDQuikT2Qoin8XlxPtuuCp1o3jMzpnG86ix7dGdAqgEO5acaxazY5rtP4J1rL8T79nNSw8C2m89btADhb6ROXOLYH1B00nw2Sc+JYGLZMq+tCGUZpyNdwRrPAzQuin9FsGKYI2ZWLDoNXQEqwBgw0Rpanqo0Pq4Dj8ltwhWBEvvpgJ2z3cH+Jd86EntatAeEJmwxjShdYtgjTHtWigAki1n+88bVt6wFNGlB8otJyzSiE7bFSfZij1mv6nQqYLWiJ6WSqPsIr7z4JjNJWeslDOUA65Yu88LrZ8lpAR32c8mwB2nEEoMpzi4RMMZE8WDNgq1/6TclD504THbz/N5IYI1LjFtoNknmbOBIlgvBJQ6zz5gXSKgcIbi4Yo1E9ZbtWaTLIJVe0tyiSVtFGqvNPuu3MbH73cLFx6z/WTCKlaXnjQRrAhWBEufXDNhZcIqSrNOsk+aQlyTwIr3UGessw9SV6xdwXL9mS96zZp9AvUaiE5MtBAu++cI3PgOk4t8NFa6r5IDVVdXDnRfp0jTflD6bReXaG7d3o1gjWlKG8JlrzS7a28XuZUcxhWpXTlpDnTfCFatDhGsLwh80kmjfEGPNl0Ea861loqZwsuzPRTOuATCxSVXPM/DLxPWmIquwinki2D56zP2eN0igjXGkHI7gjXG9GkRwRoD1X0ohe9w491qVxGlIejeLfsI1hhJpT6ZsMa4RrAuYJQ3rAJ4HRNlKnddwVwHtSue7oRFYaZqOfsE6sVP96a5UexoPNR/z542BLXvCRZtCJr3ClwpHtSe5tzjKsWD8n62/whWkQ20cEW3f81ooan/CJYTsaMvKkDUnkYewSoiRpva1aR030c6dG9ljyJsTzMaD/E9sqUNRO0zYV0TuFH93v8/glVEjDa1q0npvopAKHsUYYtgnQDlwtvFsd0TKuFSBKuIFiWZi0x03wjWtRM/E9Z6/Iot+DSLYBXRosIRwXoB68KiWKqDGRUgap8r4TWBozX98YLV+n1Ys5vIJXDUj3PCcn3KNRvr0clLmuKOsbrq0MOB5q0I+9n+Cr9JPXv9sGJvGqvtj1DgjeGXCZ2knE0+WmgaD8U6gqUgdlxDaxTBuo75qYBnwhoDS8kXwRpj2rNw4Uf9ZMKqXV+vVffa6kxYBfwiWGvf26jQOKfvFh0yYRUaZYFJBKsAcgQrghXBKjTKApMIVgHkCFYEK4JVaJQFJhGsAsgRrAhWBKvQKAtMmr+tobW3q3kpAWg8CnY0JtdbixKra29XPZUHa9fe9A2L2j9yo9xQakrW0PqvqA+JX7WNYH1BjpKSkob67xXVtbdLNFY0hCvWCNaxWhQPJ4+pcEWwIlinnKEkjmDR1rtmTw+sFfW5llFtdQQrghXB+oOA88daau2nW0WwitjNHsuLYfw1W1E41/uZc5SmedOJidqvOMFncy+CdawixZv2rmKfCSsTViasTFinHPjRgtVSS+dJTRWZTjQ/YWqh0+BsjB7x7OKAc1+XLxfe1M+jDpTfrp52YffMofVnvijxXclRUVKuIrtycxaOEtZ1Wiqkd+ZN+OHc1+VrV90iWEXmuApd3O5g5iKHS4ydWLhyc/lRDg5F/AgPVuBNc3DhTf1EsIrMcZKmuOVfM1pUF/noNEP37V2z6PQ4G6NcCY8VceFN/USwiuoRwXoB5cSCEpaKKBW+TFi1hthVtwhWrT7bHlydU0iuhC8EnNOg4qtIu6fZigOC5hDBusal5g8/0yYlRFplS6cKSj6ah7OB6N7U3tVYKyYvV6zUT29qobVW9qY1pfaufnBiEcH6UkVXgajYz96XEnXFdOqcgGiz04Oshx/1Re2V2rnWuHgZwSpWhJLDVaAIVq1AlMgU15Y95UUEq1ZPWh+lDpmwMmGd8sw1teRKeERAadJrcqGvdh3g9GDqcS+CFcGKYP1BgIp03rBqYhjBquHU/FEECmBxu6HZrn2HgZ0Y0OZVTmMXHq5YqZ8IVo1ZtM7dCav1ozm7RleF+K67M/Wz841kdqwu/zub2slhykvapBRvGs/DP42J2tfk65pV82cJncUmISqFmF1sevI6saN4uGKlmPZqTPGg9p90cLjqSf1EsIgKAVulELS56B4uEaB+etMJzZk2tct/Jqwjki7uUT8RLCBCxFQpBG0uugcVGteEEME6VvYn1MHFPeongkVUCNgqhYhgvRBwNTXFNFfCmrhSfjvfkagvag/aXDbNG1YBOpcIUD+ZsGoiQK+7O+sQwSo0XMcEfw/r2nb+SaD7EeivR3rf/ymEJXlTUhLfI1uaG72+Unvn5DXK/f3/aR0odr0DxTWduPz0sKN77LJ/4v34tJMSwWFPyaE0irLGkRttFMee//cxG1cnpk5fZxjSOlDsIlhH1Gk9qX0Ey6kUX3zRRnGGQZuOkobaZ8KqNXULJzrNKFyie+yyj2Ap1S2siWAVQOr8UQQquq3daB2UfamAu2KifnIlrHGyaUXJQYmhjOsXU/q73EkmGtNsXJU6UEGhOVD/dJpxTomUG3SaoXx52NM9dtlnwlKqW1hDSVlwWTahzU4FiNo7m70Mwh9DWgeKnXIoumKifn7MhLXrZwkp4FTVeyfHrhOZ5qyQ7I65KbU7y4P6UQSI4jc7phWcoXu4cKX7Pg+ICNaLohRAWjjqP4J1RGC2ODinQdckuoIzdA/Ke3oIdOsQwYpgkWlGIR8VGvrG5BKHCFbt0h3BKuCkkJ4CO/ukof4zYWXCWsEZugftK+WQa67JhJUJKxPW+MSkUxy1dza1a0KlfsYoHi2oUOYN6w1hCiA9aaj/TFiZsFZwhu5Bee8UY/zoTlXUlZySNN2bFo6eQC7/tAaK/S7sHrHO3lt5XqC1VjC/2xoXX514R7C+sOSOBdpF4tmiccfpUak/xWlXPZV9FTzI84LiP4IVwTrlMm1EhXyuqYXu7TzxKU6KcOxaQ3Gl9VT8R7AiWBGsPwgoDRTBGsup84CIYEWwIlgRrFMOKAKeK+FAwHug0tPvjgUan19zLHZhl0f3OfVUvN6xH2y/wI8SvAWgCyTlUde1t3MEdvpSSHunNRQLl72CwR25pORB1lANUDCKYN38SkibjhDs02wpFi57BSelGWdfp5Q8yJoIFkEL2FIiA9dPU6d/py+ax93sKRYuewWHCNYYNQWjTFiZsMbMuomFS4BcPzbTg0VpxkxYY6JFsCJYY5bcxCKC9SqESxCdpc2V0InmF1+U+DQMp3+nL5rH3ewpFi57BQeXoNAclFhdayJYLiTf/MwmgdO/09ckOJe5pVi47JUEI1hj1BSMml8cHW93Dwvn97BaGVFgnSfNrqbb+c5Dc6ZMpPV5+Kd4zOaMwlUl77N9KBa0Pt23wdbvw3JuMtNXBOuI7ieRkhKfikCLdwpGs2NVYiJi8rCdvYfLfwTromLSRqGFU0SXNhCFYLb/FVNLBOtzD7PmBJkJa9zKEawXRlSMu6flr8eH1N//5Uo45mSuhDpGW1cq0wkNOIIVwaIT52zORLBoF9/EPoL1uWP/bBHIlfBzudEU5Mdb3E20pxuGchWhDTEbB2c8Tl/k8Va5rtE1s+2dQkYnHVdudN+HvWtv1/RI/TzfPSNYs2Xq5d8pMk5fEazfCCiHIhUOl2jQfSNY6/pcJtPspqYQOONx+opgRbDOOEDFlU6umbDeEJvd1BGs8fS44mSf3Vi0zs+ri+kTUDr1KW/sc+ymAAAEt0lEQVS6rlgjWF8QoIVTSKMQk6yhxOj5dvrKhJUJKxMW6eSCbQTrCFIE64VHJqx7TLpbJyxFIAq6MzSZ3YjK5EXv2q4GGoJ1YuCq2846UOIrOJGpsnetXbG3a4+7cYP21bN3W58SupKjYO9sFJfQuPxQ7JyNtbMOESyl8uM1rp52cSOCNa7Z04ICToGNYNUK4cK1ttvYSnmwHnutWVAsal6PVhEsBbXBGiomSgh0D0qmCFatKi5ca7uNrSJYY4yUA7/lldY/V8I3JF1C4/JTo8+9T9FeDpSwrglBaaCdeys8OFvjyoEe+ArezTV5w3pB4xIalx+FqHcjZQSrVkUq3jWv9z7MlJzxo7uyCVF7qt5KPK6mdp0cvXgoHgqRz9YouLr2pvWhGFF7p+i6MLqjH3pQ0zpLV0IXkV3JKfEoQBGC0JgiWNcmASpA1D6CVWO/q6e7eNMrIW3G1uau5JR4IlhjAiq4jr3WLGh9qABR+wjWtbpZ8Y5g1YpBrGizZ8LKhEX4dVdb1xCSCesNAXqCU4JEsChiEaxriN1jdQTrSx0oGL0SRrDGBKeiO/ZYt6D1oVcOap8rYa12tEdpnX/8ozsFhDYp9V8r+xwrmpvr7fHhh+K0M1aat6taVESp/bPZ4a+8aeXm8kP9R7DeEKONQhvRRW7FD82NNm7PP8VpZ6w0b6UWZ2uoCFD7CNbFSrnGx52NQhvxImSXlu8UAYrTzlgjWGOaKWI59vqy6NX/R39xdHajUP+kaG7bnSJAcdoZawRrzLwI1heMKBiZsMYE610HaqtfVnQyzhtWDWEX71d8RYbGWkMgE9b0x146OdDCOe13Ti0Up52xZsIasy6CNWnCGkN/zUKZNs52pA298wFVISsVIAUPUkkaD/E9sqW5UbyV3CiPqf0IE/L/P/oNiwCh2LoKR0kcwVKqVbtyXPM8Xk1rHcE6YhrBGnOsaRHBGr9tKe9ntKlpCZUphO7hulpGsCJYLu7hP/3tInEmrGsljGAd8aMHL7W/Vq0Ilg0/V+GUiYKevK2kqR9qnwmrJg6z69MjPeUxtbc1nPJXc1ynE02a2jtBopMRxSiCda2paa1pfah/RRwiWDWU8RtWza1upZzg+m61lZTgVICof6UhXHsoB8dOPM6wWpFDjVkvK1d9VnCD1tOJRQSrgCYlEy0o9b+ClM6pciceEawXAopQE/wKrVQy6fVDBKsAIRWUnQ3qImUE6+ddU13coPwutNjBJIJFEXuzj2BdO6UpwSnetLxK49IcaEyzc37Eo+SdCWtQybxhUarXJgFXQyikp83uinXnlEirODvnCBatSNE+glUEqmGmCArZUfEfwRojHMF6YSRdCccQr7WgpH9E5xI/6ofaO5F07e1sICpy1N6FX49jd8NVwYj2kJMDrho1H91dG7j8ULAjWLWrYqs+TrLS5qL2KzgWwXKhfM1PBKuAHyUrtS+EUDZx7R3BOkJ+N1wVUaeHvpMDZQKP3rhbf5fQtYHLDwU7E1YmLMq9XAlrIk1xddpnwiqgSU9Xal8IoWzi2tt5utJpgNqXwRkYRrAiWC4u4d8emgkrExYlXwQrgkU507TPlbAGZSasGk5nVhGs+wvW/wAAbCyZ54DpKwAAAABJRU5ErkJggg==">
## Use the models
### Colab
*Disclaimer: The target deployment surface for the LiteRT models is
Android/iOS/Web and the stack has been optimized for performance on these
targets. Trying out the system in Colab is an easier way to familiarize yourself
with the LiteRT stack, with the caveat that the performance (memory and latency)
on Colab could be much worse than on a local device.*
### Android via Google AI Edge Gallery and MediaPipe
* Download and install
[the apk](https://github.com/google-ai-edge/gallery/releases/latest/download/ai-edge-gallery.apk).
* Follow the instructions in the app.
To build the demo app from source, please follow the [instructions](https://github.com/google-ai-edge/gallery/blob/main/README.md)
from the GitHub repository.
### Android or Desktop via LiteRT LM
Follow the LitRT LM [instructions](https://github.com/google-ai-edge/LiteRT-LM/blob/main/README.md) to build our Open Source LiteRT LM runtime to run LiteRT models.
### iOS via MediaPipe
* Clone the [MediaPipe samples](https://github.com/google-ai-edge/mediapipe-samples)
repository and follow the [instructions](https://github.com/google-ai-edge/mediapipe-samples/tree/main/examples/llm_inference/ios/README.md)
to build the LLM Inference iOS Sample App using XCode.
* Run the app via the iOS simulator or deploy to an iOS device.