Package com.dataai.etl.spark.api

Record Class DataAiResult

java.lang.Object
java.lang.Record
com.dataai.etl.spark.api.DataAiResult
public record DataAiResult(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> cleanRows, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> rejectedRows, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> findings, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> fieldProfiles, PipelineSummary summary) extends Record

  • Constructor Summary

    Constructors
    Constructor
    Description
    DataAiResult(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> cleanRows, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> rejectedRows, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> findings, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> fieldProfiles, PipelineSummary summary)
    Creates an instance of a DataAiResult record class.

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
    cleanRows()
    Returns the value of the cleanRows record component.
    final boolean
    equals(Object o)
    Indicates whether some other object is "equal to" this one.
    org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
    fieldProfiles()
    Returns the value of the fieldProfiles record component.
    org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
    findings()
    Returns the value of the findings record component.
    final int
    hashCode()
    Returns a hash code value for this object.
    org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>
    rejectedRows()
    Returns the value of the rejectedRows record component.
    void
    requireMinimumQualityScore(double minimumScore)
     
    PipelineSummary
    summary()
    Returns the value of the summary record component.
    final String
    toString()
    Returns a string representation of this record class.

    Methods inherited from class java.lang.Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait

  • Constructor Details

    • DataAiResult

      public DataAiResult(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> cleanRows, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> rejectedRows, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> findings, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> fieldProfiles, PipelineSummary summary)
      Creates an instance of a DataAiResult record class.
      Parameters:
      cleanRows - the value for the cleanRows record component
      rejectedRows - the value for the rejectedRows record component
      findings - the value for the findings record component
      fieldProfiles - the value for the fieldProfiles record component
      summary - the value for the summary record component

  • Method Details

    • requireMinimumQualityScore

      public void requireMinimumQualityScore(double minimumScore)

    • toString

      public final String toString()
      Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.
      Specified by:
      toString in class Record
      Returns:
      a string representation of this object

    • hashCode

      public final int hashCode()
      Returns a hash code value for this object. The value is derived from the hash code of each of the record components.
      Specified by:
      hashCode in class Record
      Returns:
      a hash code value for this object

    • equals

      public final boolean equals(Object o)
      Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. All components in this record class are compared with Objects::equals(Object,Object).
      Specified by:
      equals in class Record
      Parameters:
      o - the object with which to compare
      Returns:
      true if this object is the same as the o argument; false otherwise.

    • cleanRows

      public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> cleanRows()
      Returns the value of the cleanRows record component.
      Returns:
      the value of the cleanRows record component

    • rejectedRows

      public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> rejectedRows()
      Returns the value of the rejectedRows record component.
      Returns:
      the value of the rejectedRows record component

    • findings

      public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> findings()
      Returns the value of the findings record component.
      Returns:
      the value of the findings record component

    • fieldProfiles

      public org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> fieldProfiles()
      Returns the value of the fieldProfiles record component.
      Returns:
      the value of the fieldProfiles record component

    • summary

      public PipelineSummary summary()
      Returns the value of the summary record component.
      Returns:
      the value of the summary record component