LogoLogo
search
Ctrlk
AboutBlogLaunch app ↗
  • Introduction to AI Testing
  • Welcome to Distributional
  • Motivation
  • What is AI Testing?
  • Stages in the AI Software Development Lifecyclechevron-right
  • Distributional Testing
  • Getting Access to Distributional
  • Learning about Distributional
    • The Distributional Framework
    • Defining Tests in Distributionalchevron-right
    • Reviewing Test Sessions and Runs in Distributionalchevron-right
    • Data in Distributionalchevron-right
  • Using Distributional
    • Getting Started
    • Accesschevron-right
    • Datachevron-right
    • Testingchevron-right
    • Python SDKchevron-right
      • Quick Start
      • Functionschevron-right
      • Objectschevron-right
      • Experimental Functionschevron-right
      • Eval Modulechevron-right
        • Quick Start
        • Application Metric Sets
        • How-To / FAQ
        • LLM-as-judge and Embedding Metrics
        • RAG / Question Answer Example
        • Eval Module Functionschevron-right
          • Index of functions
          • eval
          • eval.metrics
    • Notifications
  • Tutorials
    • Instructions
    • Hello World (Sentiment Classifier)
    • Trading Strategy
    • LLM Text Summarizationchevron-right
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. Using Distributionalchevron-right
  2. Python SDKchevron-right
  3. Eval Modulechevron-right
  4. Eval Module Functions

Index of functions

  • eval

    • evaluate()

    • get_column_schemas_from_dataframe_and_metrics()

    • get_column_schemas_from_metrics()

  • eval.metrics

    • Metric

    • RougeScoreType

    • answer_quality_llm_accuracy()

    • answer_quality_llm_answer_correctness()

    • answer_quality_llm_answer_similarity()

    • answer_quality_llm_coherence()

    • answer_quality_llm_commital()

    • answer_quality_llm_completeness()

    • answer_quality_llm_contextual_relevance()

    • answer_quality_llm_faithfulness()

    • answer_quality_llm_grammar_accuracy()

    • answer_quality_llm_metrics()

    • answer_quality_llm_originality()

    • answer_quality_llm_relevance()

    • answer_viability_llm_metrics()

    • answer_viability_llm_reading_complexity()

    • answer_viability_llm_sentiment_assessment()

    • answer_viability_llm_text_fluency()

    • answer_viability_llm_text_toxicity()

    • automated_readability_index()

    • bleu()

    • character_count()

    • context_hit()

    • count_metrics()

    • flesch_kincaid_grade()

    • ground_truth_non_llm_answer_metrics()

    • ground_truth_non_llm_retrieval_metrics()

    • inner_product_retrieval()

    • inner_product_target_prediction()

    • levenshtein()

    • mrr()

    • non_llm_non_ground_truth_metrics()

    • quality_llm_text_similarity()

    • question_and_answer_metrics()

    • question_and_answer_metrics_extended()

    • rouge1()

    • rouge2()

    • rougeL()

    • rougeLsum()

    • rouge_metrics()

    • sentence_count()

    • summarization_metrics()

    • token_count()

    • text_metrics()

    • word_count()

PreviousEval Module Functionschevron-leftNextevalchevron-right

Was this helpful?

© 2025 Distributional, Inc. All Rights Reserved.

Was this helpful?