Instructions to use Joaoffg/ELM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Joaoffg/ELM with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Joaoffg/ELM")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Joaoffg/ELM") model = AutoModelForCausalLM.from_pretrained("Joaoffg/ELM", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Joaoffg/ELM with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Joaoffg/ELM" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Joaoffg/ELM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Joaoffg/ELM
- SGLang
How to use Joaoffg/ELM with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Joaoffg/ELM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Joaoffg/ELM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Joaoffg/ELM" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Joaoffg/ELM", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Joaoffg/ELM with Docker Model Runner:
docker model run hf.co/Joaoffg/ELM
Model Card for the Erasmian Language Model
ELM is a community driven large language model tailored to the research and education needs of Erasmus University (EUR, Netherlands) students and staff.
The model draws inspiration from ChatGPT and Llama in terms of architecture, but it aims to be privacy sensitive, environmentally conscious, and from and for the Erasmus community.
We hope that the ELM experience becomes a template for community driven, decentralized and purpuseful AI development and application.
November 2026 update: all personal data was removed from the training set and the model was retrained accordingly.
Model Details
Model Description
The underlying language model is trained and fine-tuned on academic outputs from Erasmus University, such as scientific papers or student theses; Training and fine-tuning the model is a joint effort of students and staff, transparent for all parties involved; The prompt-response examples used to fine tune the model come from students and staff, not crowdsourcing services; Defining what is the "better" model output also comes from the perspective of research and education. The true richness of ELM lies in the way its training data is generated. What is the "state-of-the-art" model may change quickly, but quality data will maintain its relevance and ensure that ELM and its future iterations serve the needs of the community that nurtured it.
- Developed by: João Gonçalves, Nick Jelicic
- Funded by [optional]: Convergence AI and Digitalization, Erasmus Trustfonds
- Model type: Llama-2 Instruct
- Language(s) (NLP): English, Dutch
- License: Llama2
Model Sources
- Repository: https://github.com/Joaoffg/ELM
- Paper: https://arxiv.org/abs/2408.06931
- Demo: https://huggingface.co/spaces/Joaoffg/Joaoffg-ELM
Copyright policy: ELM should be used exclusively for research purpuses and makes use of the Text Data Mining exception for scientific research. The size of the model should not allow it to reproduce the content that it was trained on, and this was verified in testing.
However, any authors of EUR Pure Research outputs or MA Theses in the EUR Thesis Repository who wish for their works to not be used in the model can contact ferreiragoncalves@eshcc.eur.nl to request that the model is retrained without their works.
- Downloads last month
- 379