com.databricks.labs.automl.feature.DataEvaluator.scala Maven / Gradle / Ivy

Go to download

Show more of this group Show more artifacts with this name
Show all versions of automatedml_2.11 Show documentation

Databricks Labs AutoML toolkit

The newest version!

package com.databricks.labs.automl.feature

class DataEvaluator {

  //TODO: make this useable as a stand-alone data exploration toolkit.

  //TODO: phase 1 - run through a supplied DF and get the scores for Variance / Information Gain of each field

  //TODO: phase 2 - Provide test suite for Shapiro-Wilk test for normalcy

  //TODO: phase 3 - Provide test suite for Agostino normalcy ?

  //TODO: phase 4 - PCA

  //TODO: phase 5 - Pearson report

}