Ratings and Reviews 0 Ratings

Total
ease
features
design
support

This software has no reviews. Be the first to write a review.

Write a Review

Ratings and Reviews 1 Rating

Total
ease
features
design
support

Alternatives to Consider

  • LM-Kit.NET Reviews & Ratings
    29 Ratings
    Company Website
  • Gemini Enterprise Agent Platform Reviews & Ratings
    1,161 Ratings
    Company Website
  • isoTracker Quality Management Reviews & Ratings
    19 Ratings
    Company Website
  • MuukTest Reviews & Ratings
    34 Ratings
    Company Website
  • DialerAI Reviews & Ratings
    5 Ratings
    Company Website
  • 800.com Reviews & Ratings
    2,436 Ratings
    Company Website
  • VKS Reviews & Ratings
    26 Ratings
    Company Website
  • AI Video Cut Reviews & Ratings
    1 Rating
    Company Website
  • Kitecyber Reviews & Ratings
    87 Ratings
    Company Website
  • Bigly Sales Reviews & Ratings
    9 Ratings
    Company Website

What is evalship?

evalship is a GitHub App for teams that ship LLM features and test them with evals. It works in three parts. Review: your coding agent checks the scorers, judges and prompts in your evals and lists their flaws with a fix for each. Pull requests: evalship comments on every pull request with what really broke and why, separating real regressions from flaky evals, and its check can gate the merge. Optimize: your agent tries changes such as a newer or cheaper model, a lower reasoning effort or less context, and evalship says which win beyond chance, with the gap in pass rate, cost and time. A Monitor page per repository and a weekly report email keep the team current. Results come from pytest, Vitest, Jest, promptfoo, Langfuse, Braintrust or LangSmith. Free for public repositories, from $19 a month for private ones.

What is Langfuse?

Langfuse is an open-source platform designed for LLM engineering that allows teams to debug, analyze, and refine their LLM applications at no cost. With its observability feature, you can seamlessly integrate Langfuse into your application to begin capturing traces effectively. The Langfuse UI provides tools to examine and troubleshoot intricate logs as well as user sessions. Additionally, Langfuse enables you to manage prompt versions and deployments with ease through its dedicated prompts feature. In terms of analytics, Langfuse facilitates the tracking of vital metrics such as cost, latency, and overall quality of LLM outputs, delivering valuable insights via dashboards and data exports. The evaluation tool allows for the calculation and collection of scores related to your LLM completions, ensuring a thorough performance assessment. You can also conduct experiments to monitor application behavior, allowing for testing prior to the deployment of any new versions. What sets Langfuse apart is its open-source nature, compatibility with various models and frameworks, robust production readiness, and the ability to incrementally adapt by starting with a single LLM integration and gradually expanding to comprehensive tracing for more complex workflows. Furthermore, you can utilize GET requests to develop downstream applications and export relevant data as needed, enhancing the versatility and functionality of your projects.

Media

Media

Integrations Supported

GitHub Actions
Jest
pytest

Integrations Supported

Claude
Claude for Legal
DocsGPT
Dograh
Flowise
Grok Bot
GrowthBook
Lamatic.ai
LangChain
LiteLLM
Mirascope
Modulos AI Governance Platform
Netguru Omega
OpenAI
TierZero
Voker
Workers by Delos

API Availability

API Availability

Has API

Pricing Information

$19/month
Free for all public repositories, plus 1 private repository with 1 user. Team is $19/month (3 users, 2 private repositories), Pro $49/month (10 users, 5 private repositories) and Business $199/month (50 users, 25 private repositories). Yearly billing gets 2 months free. Paid plans come with a 7-day free trial.
Free Version
Free Trial Offered?

Pricing Information

$29/month
Generous free tier and Pro Plans starting at USD 29/month.
Langfuse is open source so you will always be able to host the software yourself at no cost.
Free Version
Free Trial Offered?

Supported Platforms

SaaS

Supported Platforms

SaaS
On-Prem

Customer Service / Support

Web-Based Support

Customer Service / Support

24 Hour Support
Web-Based Support

Training Options

Documentation Hub

Training Options

Documentation Hub

Company Facts

Organization Name

Garm Tech B.V.

Date Founded

2026

Company Location

Netherlands

Company Website

evalship.com

Company Facts

Organization Name

Langfuse

Date Founded

2023

Company Location

Germany

Company Website

langfuse.com

Categories and Features

LLM Evaluation

Not specified

Categories and Features

AI Observability

Not specified

LLM Evaluation

Not specified

Observability

Not specified

Prompt Management

Not specified

Popular Alternatives

DeepEval Reviews & Ratings

DeepEval

Confident AI

Popular Alternatives

Galileo Reviews & Ratings

Galileo

Cisco