DataAI ETL .NET pipelines - Customer-Ready Evaluation

Product: .NET pipelines

Distribution: Customer-ready evaluation

Source: DataAI_ETL_DotNet_Evaluation/docs/INSTALLATION_AND_USAGE.md inside DataAI_ETL_DotNet_Evaluation.zip

Package SHA-256: 98d6705372546430ad355e51682c3300373a703d8a7fb66ae55f5a251ec64f66

Download customer-ready package | Download checksum | Read the evaluation license

Start here: Download one customer-ready ZIP. It already contains the DataAI libraries, product assets, documentation, samples, licenses, internal checksums, and local verification files for this integration. Spark, Hadoop, vendor products, and proprietary drivers remain customer-provided.

.NET pipelines: Customer Evaluation Installation and Usage

This is the customer-ready DataAI ETL evaluation package from Yanbor LLC, provider of the DataAI product. DataAI runs inside the customer's pipeline; it is not a hosted service and makes no required DataAI network call.

Prerequisites

.NET 8 SDK
Java 17
Apache Spark 3.5.0 with Scala 2.12

Installation and first verification

Review LICENSE.md before installation.
Run nuget-smoke-test\run-nuget-smoke-test.ps1 to restore both packages from the local install folder and verify their assemblies and embedded DataAI JARs.
Add Yanbor.DataAI.Etl.Spark from the customer's approved private feed or the extracted install folder.
Generate the quality-job JSON and spark-submit argument list in the customer's .NET application.
Run the generated command only against approved non-production Spark tables and verify the selected outputs.

Evaluation boundary

Use only fictional or approved non-production data.
Review LICENSE.md; the standard evaluation is less than 32 consecutive calendar days.
DataAI software is provided AS IS, with no obligations except those expressly accepted in a signed commercial agreement or order form.
Spark, Hadoop, cloud platforms, BI tools, orchestration products, and vendor drivers remain customer-provided and governed by their respective terms.
A successful local smoke test validates the delivered DataAI artifacts. It does not claim certification on the customer's external platform.

Package layout

install/: platform-specific installer or packages, when applicable.
lib/: DataAI JARs required by Spark-based integrations.
smoke-test/ or nuget-smoke-test/: executable local verification.
docs/: complete function catalog and product-specific guidance.
samples/: fictional evaluation inputs.
platform/: platform-specific examples, notebooks, configuration, POMs, or container-review assets.
PACKAGE_CONTENTS.sha256: SHA-256 for every other file in this ZIP.

NuGet Package Smoke Test

This .NET 8 console project restores both DataAI evaluation packages from the ZIP's local install folder. It verifies that the assemblies load, all five DataAI Spark artifacts are copied into the consumer output, the function catalog includes matrix balancing, configuration JSON is compatible with the Java CLI, and a safe spark-submit argument list can be generated.

Run from the extracted package root:

.\nuget-smoke-test\run-nuget-smoke-test.ps1

If the customer's Windows policy blocks direct script invocation and the customer's security policy permits a process-only override, run:

powershell.exe -NoProfile -ExecutionPolicy Bypass -File `
  .\nuget-smoke-test\run-nuget-smoke-test.ps1

This option applies only to that PowerShell process; it does not change the computer's execution policy.

Success requires DATAAI_NUGET_SMOKE_TEST_PASS. The check does not contact a DataAI service and does not run Spark or write customer data.

Verify the downloaded ZIP

$expected = (Get-Content .\DataAI_ETL_DotNet_Evaluation.zip.sha256).Split()[0]
$actual = (Get-FileHash .\DataAI_ETL_DotNet_Evaluation.zip -Algorithm SHA256).Hash.ToLowerInvariant()
if ($actual -ne $expected) { throw 'DataAI ETL package checksum mismatch.' }