Skip to main content

Feedback analytics

Compare chat ratings and arena verdicts, read comments, and investigate changes in answer quality.

3 min read

Use Settings > Metrics > Feedback as an Admin or Owner to review the feedback members submit in chat. Ratings tell you what people judged useful; their comments help explain why.

Find the feedback you need

Choose a period, then narrow by feedback type, assistant, or model. The available windows are 1, 7, 30, and 90 days, plus all time; the initial view uses 7 days. Selecting an assistant or model in a breakdown filters the view. Clear the filter chips to broaden it again. Tale attributes each rating from the rated reply itself: the model and provider that answered, and the assistant the conversation runs under. The assistant is the one the conversation runs under when the rating is given, not necessarily the one that wrote the reply: after a conversation switches assistants, a rating on an earlier reply counts for the new assistant. A reply in a plain chat, outside any assistant, is listed as Unattributed.

Use Comments only to focus on written explanations. If no feedback appears, check the period and filters before concluding that nobody has rated a reply. Feedback is voluntary; an unrated answer is neither a positive nor a negative vote.

Keep the signals separate

SignalWhat it tells you
Thumbs up/downWhether a member found a particular reply helpful. An optional comment provides context.
Arena verdictWhich answer a member preferred in a specific pair, or whether the pair tied or both were bad. A verdict cast on two copies of the same model is counted under Same model, apart from the verdicts and the matchup table.

Members can change or withdraw a rating. The dashboard reflects the current state, not a permanent count of every click. Arena mode explains how members compare two answers.

Compare results fairly

Read the number of ratings alongside the helpful ratio. One positive vote is weaker evidence than repeated feedback across the tasks a model actually handles. Compare similar periods and tasks before attributing a change to a model or an assistant configuration.

Use the assistant and model tables to locate the change, the trend to find its timing, and Recent feedback to read comments. For arena results, compare the same model pairing; a win against one model does not establish superiority over every model.

Understand partial results

Large windows can reach the aggregation limit of 50,000 entries. If Tale shows a partial-results notice, narrow the period before drawing conclusions. Retention and deletion also affect which ratings and comments remain available; this view is not a permanent archive of member feedback.

© 2026 Tale by Ruler GmbH — ISO 27001 & SOC 2 certified.

Tale is MIT licensed — free to use, modify, and distribute.