OpenHermes 2.5 Mistral 7B

A continuation of OpenHermes 2 model, trained on additional code datasets. Potentially the most interesting finding from training on a good ratio (est. of around 7-14% of the total dataset) of code instruction was that it has boosted several non-code benchmarks, including TruthfulQA, AGIEval, and GPT4All suite.

OpenHermes 2.5 Mistral 7B has a 4,096 token context window.

OpenHermes 2.5 Mistral 7B was released on November 20, 2023. Its knowledge cutoff is September 30, 2023.