Ratings and Reviews 0 Ratings

Total 0 out of 5 stars
ease 0 out of 5 stars
features 0 out of 5 stars
design 0 out of 5 stars
support 0 out of 5 stars

This software has no reviews. Be the first to write a review.

Write a Review

Ratings and Reviews 0 Ratings

Total 0 out of 5 stars
ease 0 out of 5 stars
features 0 out of 5 stars
design 0 out of 5 stars
support 0 out of 5 stars

This software has no reviews. Be the first to write a review.

Write a Review

Alternatives to Consider

  • TIMi Reviews & Ratings
    4.9 out of 5 stars 68 Ratings
    Company Website for TIMi
  • SCIKIQ Reviews & Ratings
    4.6 out of 5 stars 14 Ratings
    Company Website for SCIKIQ
  • Google Cloud BigQuery Reviews & Ratings
    4.5 out of 5 stars 2,037 Ratings
    Company Website for Google Cloud BigQuery
  • Denodo Reviews & Ratings
    4.6 out of 5 stars 388 Ratings
    Company Website for Denodo
  • Plauti Reviews & Ratings
    4.4 out of 5 stars 124 Ratings
    Company Website for Plauti
  • DataHub Reviews & Ratings
    4.5 out of 5 stars 10 Ratings
    Company Website for DataHub
  • Kitecyber Reviews & Ratings
    4.9 out of 5 stars 89 Ratings
    Company Website for Kitecyber
  • D&B Connect Reviews & Ratings
    4.1 out of 5 stars 189 Ratings
    Company Website for D&B Connect
  • Google Cloud Platform Reviews & Ratings
    4.5 out of 5 stars 61,093 Ratings
    Company Website for Google Cloud Platform
  • AnalyticsCreator Reviews & Ratings
    4.6 out of 5 stars 46 Ratings
    Company Website for AnalyticsCreator

What is IBM Data Refinery?

The data refinery tool, available via IBM Watson® Studio and Watson™ Knowledge Catalog, significantly accelerates the data preparation process by rapidly transforming vast amounts of raw data into high-quality, usable information ideal for analytics. It empowers users to interactively discover, clean, and modify their data through more than 100 pre-built operations, eliminating the need for any coding skills. Various integrated charts, graphs, and statistical tools provide insights into the quality and distribution of the data. The tool automatically recognizes data types and applies relevant business classifications to ensure both accuracy and applicability. Additionally, it facilitates easy access to and exploration of data from numerous sources, whether hosted on-premises or in the cloud. Data governance policies formulated by experts are seamlessly enforced within the tool, contributing to an enhanced level of compliance. Users can also schedule executions of data flows for reliable outcomes, allowing them to monitor these flows while receiving prompt notifications. Moreover, the solution supports effortless scaling through Apache Spark, which enables transformation recipes to be utilized across entire datasets without the hassle of managing Apache Spark clusters. This powerful feature not only boosts efficiency but also enhances the overall effectiveness of data processing, proving to be an invaluable resource for organizations aiming to elevate their data analytics capabilities. Ultimately, this tool represents a significant advancement in streamlining data workflows for businesses.

What is Deequ?

Deequ is a groundbreaking library designed to enhance Apache Spark by enabling "unit tests for data," which helps evaluate the quality of large datasets. User feedback and contributions are highly encouraged as we strive to improve the library. The operation of Deequ requires Java 8, and it is crucial to recognize that version 2.x of Deequ is only compatible with Spark 3.1, creating a dependency between the two. Users of older Spark versions should opt for Deequ 1.x, which is available in the legacy-spark-3.0 branch. Moreover, we also provide legacy releases that support Apache Spark versions from 2.2.x to 3.0.x. The Spark versions 2.2.x and 2.3.x utilize Scala 2.11, while the 2.4.x, 3.0.x, and 3.1.x releases rely on Scala 2.12. Deequ's main objective is to conduct "unit-testing" on data to pinpoint possible issues at an early stage, thereby ensuring that mistakes are rectified before the data is utilized by consuming systems or machine learning algorithms. In the upcoming sections, we will illustrate a straightforward example that showcases the essential features of our library, emphasizing its user-friendly nature and its role in preserving data quality. This example will also reveal how Deequ can simplify the process of maintaining high standards in data management.

Media

Media

Integrations Supported

Apache Spark
IBM Cloud
IBM Cloud Pak for Watson AIOps
IBM Watson
IBM Watson Discovery
IBM Watson Language Translator
IBM Watson Recruitment
IBM watsonx Assistant

Integrations Supported

Apache Spark

API Availability

Has API

API Availability

Pricing Information

Pricing not provided
Free Trial Offered?

Pricing Information

Pricing not provided

Supported Platforms

SaaS

Supported Platforms

SaaS

Customer Service / Support

Standard Support
24 Hour Support
Web-Based Support

Customer Service / Support

Web-Based Support

Training Options

Documentation Hub
Webinars

Training Options

Documentation Hub

Company Facts

Organization Name

IBM

Date Founded

1911

Company Location

United States

Company Website

www.ibm.com/products/data-refinery

Company Facts

Organization Name

Deequ

Company Website

github.com/awslabs/deequ

Categories and Features

Data Preparation

Not specified

Categories and Features

Unit Testing

Not specified

Popular Alternatives

Kylo Reviews & Ratings

Kylo

Teradata

Popular Alternatives

Spark Streaming Reviews & Ratings

Spark Streaming

Apache Software Foundation
Amazon EMR Reviews & Ratings

Amazon EMR

Amazon
MLlib Reviews & Ratings

MLlib

Apache Software Foundation
Apache Spark Reviews & Ratings

Apache Spark

Apache Software Foundation
Apache Spark Reviews & Ratings

Apache Spark

Apache Software Foundation
MLlib Reviews & Ratings

MLlib

Apache Software Foundation
Apache Mahout Reviews & Ratings

Apache Mahout

Apache Software Foundation