DataAI ETL SSIS - Customer-Ready Evaluation

Product: SSIS

Distribution: Customer-ready evaluation

Source: DataAI_ETL_SSIS_Evaluation/docs/INSTALLATION_AND_USAGE.md inside DataAI_ETL_SSIS_Evaluation.zip

Package SHA-256: 60902dfb1a70360ee7742b23ca053865d4aed72fd494dd85ad93dc8cb0cdaf59

Download customer-ready package | Download checksum | Read the evaluation license

Start here: Download one customer-ready ZIP. It already contains the DataAI libraries, product assets, documentation, samples, licenses, internal checksums, and local verification files for this integration. Spark, Hadoop, vendor products, and proprietary drivers remain customer-provided.

SSIS: Customer Evaluation Installation and Usage

This is the customer-ready DataAI ETL evaluation package from Yanbor LLC, provider of the DataAI product. DataAI runs inside the customer's pipeline; it is not a hosted service and makes no required DataAI network call.

Prerequisites

Installation and first verification

  1. Review LICENSE.md and extract the ZIP on the approved SSIS execution host.
  2. Run smoke-test\run-smoke-test.ps1 to verify the delivered DataAI libraries with fictional in-memory rows.
  3. Use an SSIS Execute Process Task or an approved scheduler to invoke spark-submit with lib\dataai-spark-cli-0.1.0-SNAPSHOT.jar and a customer-owned JSON configuration.
  4. Keep credentials in the customer's SSIS/Spark secret mechanism; do not put them in DataAI configuration files.
  5. Verify clean, rejected, findings, and profile tables in isolated evaluation schemas. No SSIS MSI is included.

Evaluation boundary

Package layout

Local DataAI Library Smoke Test

This test uses only fictional in-memory rows. It starts local Spark, executes normalization, profiling, required and numeric quality rules, clean/rejected routing, the complete function-catalog check, and iterative matrix balancing.

Requirements

  • Java 17.
  • Apache Spark 3.5.0 with Scala 2.12.
  • spark-submit available on PATH, or supplied with -SparkSubmit.

Spark and Hadoop are customer-provided runtimes and are intentionally not bundled in the DataAI evaluation ZIP.

Run

From the extracted package root:

.\smoke-test\run-smoke-test.ps1

If the customer's Windows policy blocks direct script invocation and the customer's security policy permits a process-only override, run:

powershell.exe -NoProfile -ExecutionPolicy Bypass -File `
  .\smoke-test\run-smoke-test.ps1

This option applies only to that PowerShell process; it does not change the computer's execution policy.

For an explicit executable path:

.\smoke-test\run-smoke-test.ps1 `
  -SparkSubmit 'C:\spark\bin\spark-submit.cmd'

Success requires exit code 0 and a DATAAI_*_SMOKE_TEST_PASS marker. This local check validates the delivered DataAI libraries. It does not replace the documented validation on Databricks, AWS, Azure, Oracle, Google Cloud, Tableau, Alteryx, or another customer-selected external platform.

Verify the downloaded ZIP

$expected = (Get-Content .\DataAI_ETL_SSIS_Evaluation.zip.sha256).Split()[0]
$actual = (Get-FileHash .\DataAI_ETL_SSIS_Evaluation.zip -Algorithm SHA256).Hash.ToLowerInvariant()
if ($actual -ne $expected) { throw 'DataAI ETL package checksum mismatch.' }