Getting started with Galactica language model
Galactica is science-oriented 120B parameter language model. It predicts protein annotations, creates lecture notes and explains mathematical formulas as text. Let’s get started!
5 min readNov 18, 2022
Introduction
Galatica is large open-source language model by Meta AI. The model manages multiple science tasks using single model. Galatica model performs reasoning, creates lecture notes, predict citations and more.
The model explains as text mathematical formulas and python code.
The model is relevant, because it offer State-of-the-Art performance on science-oriented datasets. For example it offers less toxic speech in the TruthfulQA-dataset compared to the upgraded GPT-3 or the OPT.
The model is able to cite sources of mathematical formulas.
The full model is available as open source project. Let’s get started with this open-source project!
Getting started
The model is available via Github with only few lines of code.
