# Databricks Marketplace Listing Copy

**Publisher:** Yanbor LLC, provider of the DataAI product.

## General

**Listing name:** DataAI ETL Spark Libraries

**Short description:** Embed governed data quality, analytics, market, mapping, matrix balancing, and explainable insight functions in customer-controlled Spark pipelines.

**Recommended availability:** Personalized listing requiring provider approval

**Recommended publication:** Public Marketplace for discovery or a private
exchange for a named commercial customer

## Detailed description

DataAI ETL gives data engineering, governance, and analytics teams a reusable
Java/Spark library that executes directly inside their Databricks pipelines.
It provides normalization, profiling, declarative validation, automatic data
quality diagnostics, analytics, time-series calculations, business and market
analysis, map readiness, iterative matrix balancing, chart recommendations,
alerts, data dictionaries, and deterministic narratives.

Customers retain control of their Spark DataFrames, Unity Catalog objects,
compute, identity, networking, scheduling, persistence, output formats, table
names, permissions, and orchestration. DataAI returns DataFrames and small
metadata records; writes occur only when customer-authored code explicitly
requests them.

The production package includes fictional sample data, importable notebooks,
documentation, integrity checks, and Java 17 / Spark 3.5 / Scala 2.12
immutable `1.0.0` artifacts. The examples demonstrate quality routing, analytical and
market summaries, matrix balancing with convergence metadata, and optional
governed Delta outputs for BI tools.

DataAI ETL is proprietary, source-available commercial software from Yanbor LLC, built with open-source technologies including Apache Spark.

## Business outcomes

- Add repeatable data-quality checks to existing Databricks jobs.
- Route accepted and rejected records with traceable findings.
- Standardize analytical and market calculations across pipelines.
- Balance matrix data against row and column control totals.
- Publish governed result tables for Databricks SQL, Power BI, or Tableau.
- Keep sensitive customer data inside the customer's Databricks environment.

## Intended users

- Data engineering and ETL teams
- Data quality and governance teams
- Databricks platform administrators
- Analytics engineering teams
- Regulated organizations requiring customer-controlled execution

## Shared asset types

- **Files:** immutable `1.0.0` JARs, fictional CSV data, documentation, and checksums
- **Notebooks:** installation, quality, analytics, market, matrix, and governed-output examples

## Requirements

- Unity Catalog-enabled Databricks workspace
- Databricks Runtime validated by the customer against Java 17, Spark 3.5.x,
  and Scala 2.12; Runtime 16.4 LTS Scala 2.12 is the initial validation target
- Permission to install JAR libraries from a Unity Catalog volume or approved
  Maven repository
- Standard-access-mode allowlist approval where required
- Customer-created output catalog and schema for optional persistence

## Privacy and data handling

DataAI ETL has no required DataAI hosted service, telemetry, remote license
check, or customer-data transmission. The included fictional data is
fictional. Databricks platform logging, usage data, Marketplace behavior, and
cloud-provider processing remain governed by the customer's Databricks and
cloud configuration.

## License and commercial terms

Production, redistribution, OEM, and managed-service rights require an
executed commercial agreement, order form, or license certificate from Yanbor
LLC. The software is provided **AS IS**. Customers are responsible for
technical, security, compatibility, and suitability testing in their target
environment.

## Categories and search terms

**Suggested categories:** Data engineering; Data quality; Analytics

**Search terms:** Apache Spark, Databricks, ETL, data quality, data profiling,
validation, analytics, market analysis, matrix balancing, Unity Catalog,
customer-controlled

## URLs to replace before submission

- Documentation: `[PUBLIC DATAAI DATABRICKS DOCUMENTATION URL]`
- Support: `[DATAAI SUPPORT URL]`
- Support email: `[DATAAI SUPPORT EMAIL]`
- Privacy: `[DATAAI PRIVACY URL]`
- Terms of service: `[DATAAI TERMS URL]`
- License terms: `[PUBLIC DATAAI LICENSE URL]`
- Company: `[YANBOR LLC COMPANY URL]`

## Media notes

Use `assets/dataai-databricks-icon.png` as the draft square icon. The images in
`screenshots/` are design previews generated from fictional data and are not
screenshots of Databricks. Replace them with approved captures from the final
workspace validation before publication.
