• Home
• tech.mlsql
• streamingpro-mlsql-spark_2.4
• 1.2.0
• source code
• sklearn-multi-model-trainning-with-sample.sql

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

test.sql.sklearn-multi-model-trainning-with-sample.sql Maven / Gradle / Ivy

load libsvm.`sample_libsvm_data.txt` as data;

train data as RateSampler.`/tmp/ratesampler`
where labelCol="label"
and sampleRate="0.9,0.1";

load parquet.`/tmp/ratesampler` as data2;

select * from data2 where __split__=1
as validateTable;

select * from data2 where __split__=0
as trainingTable;

train trainingTable as SKLearn.`/tmp/model`
where `kafkaParam.bootstrap.servers`="127.0.0.1:9092"
and `kafkaParam.topic`="test"
and `kafkaParam.group_id`="g_test-1"
and  `fitParam.0.batchSize`="1000"
and  `fitParam.0.labelSize`="2"
and  `fitParam.0.alg`="MultinomialNB"
and  `fitParam.1.batchSize`="1000"
and  `fitParam.1.labelSize`="2"
and  `fitParam.1.alg`="SVC"
and  `fitParam.2.batchSize`="1000"
and  `fitParam.2.labelSize`="2"
and  `fitParam.2.alg`="RandomForestClassifier"
and  valdateTable="validateTable"
and `systemParam.pythonPath`="python"
and `systemParam.pythonVer`="2.7";