Skip to main content

Arete-27B: why each model variant needs its own review

Camila Duarte
Camila DuarteNovember 10, 20269 min. read
Arete-27B: why each model variant needs its own review

Nous Research introduced Arete-27B in November 2026, a variant of Qwen3.8-27B post-trained to reinforce Western values. According to the model card, consulted on November 10, 2026, responses the rubric classified as adopting the Chinese state's official position fell from 22.0% to 0.9%, a difference of about 21 percentage points, while capability benchmarks stayed close. The evaluation does not prove general neutrality.

Key facts: Arete-27B starts from Qwen3.8-27B; the results come from Nous Research and apply to the conditions of the published tests. Training context is not an inference limit.

What did Arete-27B change in the base model?

Nous Research applied supervised fine-tuning, or SFT, to Qwen3.8-27B, a model from Alibaba, to produce Arete-27B. According to the Nous card, the procedure adjusted the weights without changing the architecture. The change sits in the post-trained model, not in a component the buyer switches on or off.

Pipeline diagram: Qwen3.8-27B goes through supervised fine-tuning with the Inkling teacher to produce the Arete-27B variant, evaluated on 803 prompts and five rounds, with a drop from 22.0% to 0.9% in the authors' rubric propaganda rate (responses aligned with the Chinese state's position) and an average factual score from 2.32 to 2.98 on a 0 to 5 scale; the diagram recommends separate approval per variant and endpoint.

Figure produced for this article from the Arete-27B model card and the official announcement; it is not a screenshot of the repository and not an independent laboratory record.

The weights changed. The card describes a variant whose weights were adjusted after SFT, not a configuration applied over intact weights that the buyer can enable or remove at will. The card states that all language model weights were trained, with the vision encoder frozen and the MTP head (multi-token prediction) disabled during training. The reported method used neither reinforcement learning nor preference optimization; that does not make behavior independent of model capability.

Arete-27B also does not automatically replace the base model in a policy that is already approved. Even when the team recognizes the model family, it still needs to know which variant serves the request and under which conditions the answer was produced. That record allows a result to be attributed to the version actually tested.

Why does the same base model now require two decisions?

The first decision is to choose a base model suited to the task; the second is to approve the post-trained variant that will answer the user. The Arete-27B case shows why the two should not be confused: Nous reports behavioral differences even without changing the starting architecture.

Sharing an architecture does not mean sharing answers. An evaluation of the base model can guide the investigation, but it does not authorize extending its results to Arete-27B. The team must verify whether the variant meets the application criteria, including the cases where an incorrect or incomplete answer requires human review.

Variant, checkpoint, and endpoint are not synonyms. The variant identifies the post-trained version; the checkpoint identifies the weights used; the endpoint is the access point to the service. A useful approval records all three, plus the provider and the execution conditions the team was able to verify.

The hosting decision is another part of this analysis. The piece on governance in the choice between open weights and hosted models deals with responsibility for deployment; here, the point is not to let the variant choice disappear inside the family name.

How was Arete-27B post-trained?

According to Nous Research, Arete-27B was obtained by SFT on Qwen3.8-27B, using answers from a teacher model called Inkling. The company says it chose the teacher based on benchmarks and researcher judgment. The data below describe the reported training, not the operation of an endpoint.

SpecificationReported by Nous Research
Starting modelQwen3.8-27B
MethodSupervised fine-tuning, no reinforcement learning, no preference optimization
Training volumeAbout 52.8M tokens
TrainingTwo epochs and 1,202 steps
Training context64k
Reported size and precision27B parameters; BF16 compute with FP32 master weights and optimizer states

Precision is not capability. The page describes BF16 compute during training, with master weights and optimizer states in FP32; that information describes the reported method, but it is not enough to estimate the memory required in any deployment or to infer how a service will perform.

The inference limit remains unconfirmed on the card. The 64k figure refers to training context. The 32k token generation cap (32,768) appears in the behavioral evaluation runs; it should not be turned into a general model window. Mixing those measures produces a specification the source does not offer.

What do the Arete-27B benchmarks actually show?

Nous Research reports differences in measured behavior and close results on capability tests, comparing Qwen3.8-27B with Arete-27B. The table gathers the values published on the card, consulted on November 10, 2026. Each row has its own meaning; none works as a universal grade for the model.

Published measureQwen3.8-27BArete-27BBounded reading
Factual score2.322.980 to 5 scale in the authors' evaluation
Answers above zero on the framing rubric22.0%0.9%Metric specific to the authors' evaluation, not a general propaganda rate; about 21 pp below the base model
Hermes Bench65.77%65.60%Nous reads the difference below 0.2 percentage points as noise
Terminal-Bench-2.167%70%The authors claim no credit for the apparent improvement

The definition changes the reading. In the behavioral comparison, the rubric measures the share of answers the judge classified as adopting the Chinese state's official position as its own, so the percentages do not measure propaganda in general and do not demonstrate an absence of bias on other tasks.

Nous reports that the evaluation used 803 prompts across 5 rounds, with Grok 4.7 as judge, a fixed rubric, temperature zero, and reasoning turned off for both models. According to the card, the judge did not receive the identity of the model that authored each answer. The card reports a pilot of 25 prompts scored by hand and three revisions of the rubric before the main evaluation. The 32k token generation cap (32,768) applies to those rounds.

The held-out evaluation set is linked on the card and is not the training set. Even with those details, the result depends on the prompts, the rubric, and the judge chosen. The card does not authorize the conclusion that answers will be equivalent outside the published tests.

What is not yet demonstrated?

The results presented are measurements reported by Nous Research itself, under specific conditions. They do not establish general equivalence between Arete-27B and Qwen3.8-27B, and they do not say how the variant will behave on a company's documents, languages, and instructions. The approval path begins where the benchmark ends.

Different questions carry different limits. A higher factual score on the authors' rubric does not remove the need to check answers against the sources the application uses. A close result on Hermes Bench does not guarantee that an internal task, with its own formats and acceptance criteria, will reach the same result.

The Limitations section of Propaganda_Eval states that the set is English only, so nothing in this evaluation is measured in Portuguese. The same section of Propaganda_Eval lists sources from 2025 and 2026 and warns that models with an earlier training cutoff are at a disadvantage on those prompts, so part of the gain from 2.32 to 2.98 (+0.66) may reflect temporal exposure to the post-training data, not only a change in behavior.

The card also does not report an inference price for Arete-27B. The absence of a price on the card does not prove there are no offers from other providers. On the official QwenCloud page for the Singapore region, the base model rate was consulted on November 10, 2026:

Model and serviceInput per 1 million tokensOutput per 1 million tokensEvidence limit
Qwen3.8-27B, QwenCloud, Singapore regionUS$0.50US$3.00Public service rates for the base model, checked on 2026-11-10; subject to change.
Arete-27BNot confirmedNot confirmedThe Nous card does not report an inference price; do not attribute the Qwen prices to Arete.

The rows do not allow a price difference between variants to be calculated. Cache, batch processing, latency, and total cost are also unconfirmed for this comparison. Before contracting any service, the buyer needs to check the conditions of the endpoint it intends to use and the rate in force.

How to approve and route variants in production?

The recommendation is to test each variant against criteria from the load itself and to record the approved endpoint before forwarding requests. That separates what Nous measured from what the company needs to accept in operation. The table shows a change of procedure, not a proven feature of a specific product.

DecisionApproval by family onlyApproval by variant and service
IdentityBase model nameBase, variant, and verified checkpoint
TestAggregated result for the familyCriteria and answers from the variant on the chosen load
AccessEndpoint treated as equivalentProvider, endpoint, and configuration recorded
ChangeUpdate presumed compatibleNew evaluation when identity or conditions change

The order of the work matters:

  1. Record the identity. Document the base model, the variant, the checkpoint when available, and the origin of the information. If the provider does not identify the weights used, record the gap before approving.
  2. Define the test. Select tasks that represent the application, reference answers, and acceptance criteria, including situations that require human review. Keep the same instructions when comparing variants, where technically possible.
  3. Approve the service. Confirm that the variant is available on the chosen endpoint and record the provider and execution parameters. Approval of one endpoint should not be transferred automatically to another.
  4. Track changes. Keep the test conditions and review the decision when there is a verifiable change of checkpoint, provider, or configuration. An alternative route also needs its own criteria before it receives traffic.

The recommendation is editorial. It is not a result of the Nous experiment, and the team responsible must define who approves a change and which evidence should remain available for review. The commercial name alone does not answer those questions.

Frequently asked questions

Arete-27B is a post-trained variant, and its published results have to be read together with the test conditions. The answers below are limited to the Nous Research card and to the evaluation recommendation described above. They do not establish availability at providers or approval for a specific load.

What is Arete-27B?

It is the variant Nous Research obtained by applying SFT to Qwen3.8-27B, according to the model card. The weights changed. The architecture stayed the same, but that does not mean the two versions answer the same way.

How was Arete-27B post-trained?

Nous describes supervised fine-tuning with the Inkling teacher, without reinforcement learning and without preference optimization. The reported 64k training context belongs to training; the card does not confirm the inference context limit.

What does the Arete-27B behavior evaluation measure?

According to Nous Research, the share of answers the judge classified as adopting the Chinese state's official position fell from 22.0% in Qwen3.8-27B to 0.9% in Arete-27B. The comparison used 803 prompts, five rounds, Grok 4.7 as judge, temperature zero, and reasoning turned off. The result applies to the authors' rubric, not to propaganda in general.

Did Arete-27B preserve the base model's capability?

On Hermes Bench, Nous reports 65.77% for Qwen3.8-27B and 65.60% for Arete-27B, a difference it reads as noise. That describes one specific test, not proof of equivalence on every task.

How should AI variants be evaluated before production?

Record the variant and the endpoint, test the application's tasks against defined criteria, and approve the configuration observed. If the identity of the weights or the service conditions change, the team should review the approval instead of assuming the earlier test still holds.

References and Further Reading

The sources below allow the method and the results reported by Nous Research to be checked. The card is the source of the measures presented; the linked set describes the evaluation material, while the official announcement provides the month of the presentation. The rates belong to the service identified, not to the Arete-27B variant.

The card is the primary source. To check the comparison, the buyer can also consult the evaluation set and observe which questions and criteria support the percentages Nous Research published, without extrapolating them to other tasks.

What is the buyer's next step?

The next step is to build a comparable test for the task the company intends to run and to record which variant and endpoint produced each result. Nexforce Router offers an API for access and routing and allows a prompt to be tested across several available models. The availability of Arete-27B on the Router is not confirmed.

The test requires identification. The infrastructure also offers rules per key and call tracing, features that can support the organization of tests with the available models and endpoints, without replacing the check of which service produced each answer. That does not prove automatic variant recognition or policy enforcement by checkpoint. The approval decision remains with the team, based on the results and conditions it was able to verify.

Nexforce

Accelerate your company'sbusiness and operational efficiency

We design the technology of tomorrow to boost your business operational scale

Talk to a Specialist

Related articles