Ratings and Reviews 0 Ratings

Total
ease
features
design
support

This software has no reviews. Be the first to write a review.

Write a Review

Ratings and Reviews 0 Ratings

Total
ease
features
design
support

This software has no reviews. Be the first to write a review.

Write a Review

Alternatives to Consider

  • Gemini Enterprise Agent Platform Reviews & Ratings
    1,161 Ratings
    Company Website
  • MuukTest Reviews & Ratings
    34 Ratings
    Company Website
  • LM-Kit.NET Reviews & Ratings
    29 Ratings
    Company Website
  • Hyperproof Reviews & Ratings
    350 Ratings
    Company Website
  • Bigly Sales Reviews & Ratings
    9 Ratings
    Company Website
  • CredentialStream Reviews & Ratings
    190 Ratings
    Company Website
  • Breathe Reviews & Ratings
    655 Ratings
    Company Website
  • InboxAlly Reviews & Ratings
    136 Ratings
    Company Website
  • Parasoft Reviews & Ratings
    152 Ratings
    Company Website
  • Time Management from ISGUS Reviews & Ratings
    27 Ratings
    Company Website

What is evalship?

Evalship provides engineering teams with a robust framework for evaluating LLM-driven software by performing thorough audits of evaluation suites and scrutinizing pull requests. It carefully investigates scorers and judges for possible inaccuracies, identifies gaps in coverage, and points out evaluations that could lead to erroneous results, all while delivering insights complete with code references and suggestions for enhancements. The initial setup streamlines a coding agent's task of configuring GitHub Actions and creating a setup pull request. For future pull requests, Evalship assesses the results against the default branch, detecting regressions, flaky evaluations, and any changes to prompts or model calls that lack sufficient evaluation, while also providing a status check for merge gating. It accommodates results from a variety of supported test runners and LLM evaluation tools. Evaluations occur within the customer's GitHub Actions framework using their designated model API keys, with Evalship concentrating on reviewing the results rather than executing the evaluations. Furthermore, teams have the ability to review their evaluation history and receive weekly performance reports to monitor advancements and enhancements over time. This thorough methodology guarantees that maintaining software quality is prioritized at every stage of the development process, ultimately fostering a culture of continuous improvement.

What is Galileo?

Galileo is an AI observability and eval engineering platform built to help organizations measure, protect, and improve AI applications and agents across the full development lifecycle. Now part of Cisco, Galileo is positioned around the idea that teams should not only monitor AI failures, but prevent them with production-ready guardrails. The platform helps teams capture ground truth from synthetic data, development workflows, live production traffic, and subject matter expert annotations. Galileo provides more than 20 out-of-the-box evaluations for RAG systems, agents, safety, security, and custom use cases. Its eval engineering workflow helps teams create accurate evaluators that reflect their own domain expertise instead of relying only on generic metrics. Galileo can auto-tune metrics from live feedback so evaluations become better aligned with real environments. The platform’s Luna models distill expensive LLM-as-judge evaluators into compact models that can run across production traffic at lower cost and lower latency. Galileo’s insights engine analyzes millions of signals across models, prompts, functions, context, datasets, traces, and MCP server activity to identify failure modes and recommend fixes. Teams can use these insights to debug agent behavior, improve prompts, adjust tools, detect hallucinations, and strengthen AI reliability. Galileo supports the eval-to-guardrail lifecycle, where pre-production tests become production policies that can block harmful responses, control tool access, and guide escalation paths. By combining AI observability, evals, ground-truth datasets, Luna guardrail models, agent reliability workflows, safety controls, deployment flexibility, and production monitoring, Galileo helps enterprises ship AI systems with more confidence.

Media

No images available

Media

Integrations Supported

Braintrust
GitHub Actions
Jest
LangSmith
Vitest

Integrations Supported

Amazon SageMaker
Azure OpenAI Service
Gemini
Gemini 1.5 Pro
Gemini 2.0 Flash
Gemini Enterprise
Gemini Enterprise Agent Platform
Gemini Nano
Google AI Plus
LangChain
OpenAI
Overmind
PaLM 2

API Availability

Has API

API Availability

Pricing Information

$7.60/month
The Team plan is $7.60 per month during the launch offer, 60% off its $19 monthly price for the next 9 accounts. It includes 3 users and 2 private repositories. Additional users cost $2 per month each, and additional repositories cost $10 per month each. A 7-day free trial is offered. Public repositories are free.
Free Version
Free Trial Offered?

Pricing Information

Pricing not provided

Supported Platforms

SaaS

Supported Platforms

SaaS

Customer Service / Support

Web-Based Support

Customer Service / Support

Web-Based Support

Training Options

Documentation Hub

Training Options

Online Training

Company Facts

Organization Name

Garm Tech B.V.

Date Founded

2026

Company Location

Netherlands

Company Website

evalship.com

Company Facts

Organization Name

Cisco

Company Location

United States

Company Website

www.galileo.ai/

Categories and Features

LLM Evaluation

Not specified

Categories and Features

AI Observability

Not specified

AI Security

Not specified

LLM Evaluation

Not specified

Machine Learning

Not specified

Popular Alternatives

Popular Alternatives

DeepEval Reviews & Ratings

DeepEval

Confident AI
Galileo Reviews & Ratings

Galileo

Cisco