Issues

• EvalPort: portable interchange for MetricValue results

  citadel-ai/langcheck#219 · Filter by author adhabnr-ux opened on Sep 27, 2026

• Installation issue with langcheck[ja]: chikkarpy packaging problems, dartsclone build failure on Windows, and transformers 5.x incompatibility

  citadel-ai/langcheck#218 · Filter by author okms9805 opened on Jul 13, 2026

• Support Azure AI Foundry

  citadel-ai/langcheck#177 · Filter by author liwii opened on Feb 7, 2025
  

• Support more EvalClient formats based on LLM APIs

  citadel-ai/langcheck#176 · Filter by author liwii opened on Feb 7, 2025
  6

• Multimodal (Vision) support

  citadel-ai/langcheck#175 · Filter by author liwii opened on Feb 7, 2025
  1

• Let users access the prompt & score_map objects of the built-in eval client metrics

  citadel-ai/langcheck#149 · Filter by author liwii opened on Sep 6, 2024

• Improve the stability of metrics by repeated queries

  citadel-ai/langcheck#127 · Filter by author liwii opened on Jun 26, 2024

• Follow up use_async option

  citadel-ai/langcheck#105 · Filter by author Alnusjaponica opened on Mar 26, 2024
  1

• Document maximum allowed input lengths for each metric

  citadel-ai/langcheck#85 · Filter by author yosukehigashi opened on Feb 8, 2024

• Improve testing of installation on different machines and python base images

  citadel-ai/langcheck#80 · Filter by author yosukehigashi opened on Jan 25, 2024

• Consider computing German fluency without translating to English

  citadel-ai/langcheck#78 · Filter by author ischender opened on Jan 21, 2024

• Pin versions for HuggingFace models

  citadel-ai/langcheck#71 · Filter by author kennysong opened on Dec 9, 2023
  5

  

• Add docstrings for object properties so they show up in documentation

  citadel-ai/langcheck#68 · Filter by author kennysong opened on Dec 6, 2023

• Create langcheck.utils.detect_language()

  citadel-ai/langcheck#67 · Filter by author syamaco opened on Dec 6, 2023
  7

• Allow metrics to run on GPU

  citadel-ai/langcheck#63 · Filter by author kennysong opened on Dec 5, 2023

• Eliminate unexpected spaces introduced before periods by TreebankWordDetokenizer().detokenize().

  citadel-ai/langcheck#62 · Filter by author Alnusjaponica opened on Dec 5, 2023

• Fix documentation page title for MetricValue

  citadel-ai/langcheck#41 · Filter by author kennysong opened on Nov 8, 2023

• Add "refusal to answer" metric

  citadel-ai/langcheck#24 · Filter by author kennysong opened on Oct 17, 2023
  2

• Installing tensorflow breaks the transformers library in test_factual_consistency()

  citadel-ai/langcheck#11 · Filter by author kennysong opened on Oct 10, 2023
  2

• Introduce 係り受け解析 (Dependency Analysis) - based Japanese reading ease scores

  citadel-ai/langcheck#10 · Filter by author kennysong opened on Oct 10, 2023

• Refactoring of common parts in ja/ and en/

  citadel-ai/langcheck#9 · Filter by author kennysong opened on Oct 10, 2023

• Add interactive=False parameter to plotting functions

  citadel-ai/langcheck#8 · Filter by author kennysong opened on Oct 10, 2023
  6

• Store exception messages in EvalValue

  citadel-ai/langcheck#1 · Filter by author kennysong opened on Oct 10, 2023