OpenGPT-X: Teuken-7B

Teuken-7B is available free of charge in two license versions: »Teuken-7B-instruct-research-v0.4« can be used by the scientific community and companies for research purposes, »Teuken-7B-instruct-commercial-v0.4« is available to companies for commercial purposes under the »Apache 2.0« license.

Teuken-7B-instruct-commercial-v.04 is comparable to the research version in terms of performance, although the research version achieves better results in the benchmarks by one to two percent. The reason for this is that some data sets used in the research version exclude commercial use and were therefore not used in the version for companies.

Teuken-7B is available for download free of charge and open source on Hugging Face.

Companies in particular have the opportunity to take part in a free webinar in which Fraunhofer scientists explain which applications can be realized with appropriate further processing on the basis of Teuken-7B.

• register: webinar in German
• register: webinar in English

Teuken-7B is multilingual and has been optimized for chat through “instruction tuning”, so it can be used as a multilingual chatbot, e.g. in international customer service or to make company knowledge accessible to employees.

The following other applications can be implemented with Teuken-7B:

Areas of application:

• Summarize documents
  
• Generate texts
  
• Extracting information from texts
  

Teuken-7B can be further processed through Continued Pretraining, Finetuning, Instruction Tuning, Model Merging etc. in order to adapt the model to the company's own purposes. The result is a model that is optimized for the individual use cases in the company.

In order to adapt the model to your own business purposes, Teuken-7B-instruct-commercial can also be further processed with your own data through Continued Pretraining, Finetuning, Instruction Tuning, Model Merging, etc.

The model performs well in a performance comparison with other open source models, but still has potential for development in the areas of logical thinking, coding and mathematics. In addition, Teuken-7B, like other large language models, can generate content that is inappropriate, offensive or harmful.

Teuken-7B-instruct is a chatbot that is primarily intended for corporate applications and research projects. Developers from companies and the scientific community can use it to develop their individual chat applications. Teuken-7B-instruct-commercial can also be further processed with your own data through continued pretraining, fine-tuning, instruction tuning, model merging, etc. to adapt the model to your own business purposes.

Yes, companies can use Teuken-7B-instruct-commercial-v0.4 commercially for their AI applications under the Apache 2.0 license.

Basic models are particularly susceptible to the generation of inappropriate, offensive or harmful content. At the same time, base models offer the advantage that they can be developed into powerful special models through fine-tuning and instruction tuning if used correctly and responsibly.
For this reason, the Teuken-7B-base-v0.4 base model is not published, but companies and other stakeholders interested in the base model can contact Fraunhofer IAIS so that the use of the base model can be coordinated and supported.

Inquiries by mail to: contact@opengpt-x.de

Currently no. The EU AI Act will not apply until August 2025. AI models that were placed on the market before this date do not have to comply with the requirements of the EU AI Act until August 2027 (grandfathering).

The OpenGPT-X research project is nearing completion with the release of Teuken-7B-instruct-v0.4 and will run until March 31, 2025. Until then, we will continue to optimize and evaluate the model. There is development potential for the model for relevant tasks such as logical thinking, coding and mathematics as well as bias and toxicity. Furthermore, by continuing the model training, we can increase the number of tokens (context window) processed simultaneously by the model.

As this is an open source project, we also assume that adapted or specialized versions of the model will be developed for different applications by the scientific community or companies.

All evaluation results are available on our European Leaderboard:

• to the Leaderboard

For technical information on the model and its application, please refer to our model card:

• to the model card

We have summarized the key findings of the evaluation:

• to the benchmark graphics

A detailed review of the model can be found here:

• to the OpenGPT-X project website
  

Our scientists are in contact with the LLM community via the OpenGPT-X Discord server. This is also the place for questions and feedback about the model.

• join the discussion