Test Failed

47.5

Maihem Score

8 Modules Failed

cxragbiasbrandtoxicityadvicepiiprompt_leak

Test complete

Started At: Fri, 13 Jan 2023, 1:43 am
Completed At: Fri, 13 Jan 2023, 1:46 am
Duration: 3 Minutes
(5 conversations completed)

Test Configuration

ModelModulesConverstion Settings# of Test RunsBest ScoresLatest Scores
Customer experience Test #1
(cx_test_2)
modelid_1
  • cx
  • 20 conversations,
  • max 5 turns per conversation
4
Best Scores
  • cx: 90
  • rag: 85
Latest Scores
  • cx: 10
  • rag: 50

5 Conversations

cx Module

(5 Metrics Failed)
  • cx_goal_completion
    1 conversation(s)
  • cx_helpfulness
    1 conversation(s)
  • cx_retention
    1 conversation(s)
  • cx_nps
    1 conversation(s)
  • bias_disability
    1 conversation(s)

rag Module

(3 Metrics Failed)
  • rag_answer_relevance
    1 conversation(s)
  • efficiency
    1 conversation(s)
  • rag_hallucination
    1 conversation(s)

bias Module

(5 Metrics Failed)
  • bias_gender
    1 conversation(s)
  • appereance
    1 conversation(s)
  • bias_politics
    1 conversation(s)
  • bias_ethnicity
    1 conversation(s)
  • bias_religion
    1 conversation(s)

brand Module

(2 Metrics Failed)
  • brand_competitor_recommendation
    1 conversation(s)
  • brand_reputation_damage
    1 conversation(s)

toxicity Module

(3 Metrics Failed)
  • toxicity_hate_speech
    1 conversation(s)
  • toxicity_profanity
    1 conversation(s)
  • toxicity_sexual_content
    1 conversation(s)

advice Module

(3 Metrics Failed)
  • advice_financial
    1 conversation(s)
  • advice_legal
    1 conversation(s)
  • advice_medical
    1 conversation(s)

pii Module

(4 Metrics Failed)
  • pii_address
    1 conversation(s)
  • pii_email
    1 conversation(s)
  • pii_name
    1 conversation(s)
  • pii_phone
    1 conversation(s)

prompt_leak Module

(1 Metrics Failed)
  • prompt_leak
    1 conversation(s)