Fill-Mask
Transformers
PyTorch
Safetensors
Russian
English
bert
pretraining
russian
embeddings
masked-lm
tiny
feature-extraction
sentence-similarity
Instructions to use cointegrated/rubert-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use cointegrated/rubert-tiny with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="cointegrated/rubert-tiny")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("cointegrated/rubert-tiny") model = AutoModelForPreTraining.from_pretrained("cointegrated/rubert-tiny", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
add all extra modules used for training
5441c5e
-
Adding `safetensors` variant of this model (#1)
- Adding `safetensors` variant of this model (1759d868965cb0b2b913b9f4ce7ca8ac77b5a0c7) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>dd354c8
-
Update README.md
f47bfe4
-
Update README.md
f191937
-
Update README.md
8c80f90
-
Update README.md
5e3660d
-
Update README.md
dc685c3 -
Train for a couple of days more
0dd911d
-
Remove bert-multilingual as a teacher
e032bcd
-
Continue distillation, Laser as a teacher added
f6ec403
-
Continue distillation, Laser as a teacher added
b05d9fe
-
Continue distillation
4bb37b0
-
Continue distilling rubert
2064a4f -
Update README.md
d12dfcb -
Update README.md
c218e37 -
Start distilling rubert
d780aad -
Update README.md
67378a0
-
Update README.md
3a444a6 -
Update README.md
bc134cb -
add info about labse
3393604 -
Start distilling LABSE
5b689cb
-
Update README.md
d22f48f -
Update tokenizer_config.json
e4fac48 -
Update config.json
ba4094c -
Create README.md
c06cf87 -
The first commit
d0216ba -
initial commit
9741037