DataAI ETL Oracle AIDP Spark - Customer-Ready Evaluation

Product: Oracle AIDP Spark

Distribution: Customer-ready evaluation

Source: DataAI_ETL_Oracle_AIDP_Evaluation/docs/INSTALLATION_AND_USAGE.md inside DataAI_ETL_Oracle_AIDP_Evaluation.zip

Package SHA-256: 1eeba40f96e2a3fb67057480715d8978915c7a698eb3a343b91d9b55e4126dab

Download customer-ready package | Download checksum | Read the evaluation license

Start here: Download one customer-ready ZIP. It already contains the DataAI libraries, product assets, documentation, samples, licenses, internal checksums, and local verification files for this integration. Spark, Hadoop, vendor products, and proprietary drivers remain customer-provided.

Oracle AIDP Spark: Customer Evaluation Installation and Usage

This is the customer-ready DataAI ETL evaluation package from Yanbor LLC, provider of the DataAI product. DataAI runs inside the customer's pipeline; it is not a hosted service and makes no required DataAI network call.

Prerequisites

Installation and first verification

  1. Review LICENSE.md and run smoke-test\run-smoke-test.ps1 on compatible local or edge-node Spark.
  2. Upload the DataAI JARs to a customer-controlled artifact location visible to the Oracle Spark job.
  3. Create isolated source and output schemas and grant the evaluation job identity minimum permissions.
  4. Run the configuration-driven CLI or embed the libraries in the Oracle Spark application.
  5. Verify output row counts, quality findings, matrix results, permissions, and retry behavior on the exact Oracle runtime.

Evaluation boundary

Package layout

Local DataAI Library Smoke Test

This test uses only fictional in-memory rows. It starts local Spark, executes normalization, profiling, required and numeric quality rules, clean/rejected routing, the complete function-catalog check, and iterative matrix balancing.

Requirements

  • Java 17.
  • Apache Spark 3.5.0 with Scala 2.12.
  • spark-submit available on PATH, or supplied with -SparkSubmit.

Spark and Hadoop are customer-provided runtimes and are intentionally not bundled in the DataAI evaluation ZIP.

Run

From the extracted package root:

.\smoke-test\run-smoke-test.ps1

If the customer's Windows policy blocks direct script invocation and the customer's security policy permits a process-only override, run:

powershell.exe -NoProfile -ExecutionPolicy Bypass -File `
  .\smoke-test\run-smoke-test.ps1

This option applies only to that PowerShell process; it does not change the computer's execution policy.

For an explicit executable path:

.\smoke-test\run-smoke-test.ps1 `
  -SparkSubmit 'C:\spark\bin\spark-submit.cmd'

Success requires exit code 0 and a DATAAI_*_SMOKE_TEST_PASS marker. This local check validates the delivered DataAI libraries. It does not replace the documented validation on Databricks, AWS, Azure, Oracle, Google Cloud, Tableau, Alteryx, or another customer-selected external platform.

Verify the downloaded ZIP

$expected = (Get-Content .\DataAI_ETL_Oracle_AIDP_Evaluation.zip.sha256).Split()[0]
$actual = (Get-FileHash .\DataAI_ETL_Oracle_AIDP_Evaluation.zip -Algorithm SHA256).Hash.ToLowerInvariant()
if ($actual -ne $expected) { throw 'DataAI ETL package checksum mismatch.' }