|
| ||||
| |||||
| Package | Description |
|---|---|
| org.apache.ignite.ml.dataset |
Base package for machine learning dataset classes.
|
| org.apache.ignite.ml.dataset.impl.cache |
Base package for cache based implementation of machine learning dataset.
|
| org.apache.ignite.ml.dataset.impl.cache.util |
Contains util classes used in cache based implementation of dataset.
|
| org.apache.ignite.ml.dataset.impl.local |
Base package for local implementation of machine learning dataset.
|
| org.apache.ignite.ml.sql |
Contains util classes that help to work with machine learning models in SQL and train models on data from SQL tables.
|
| org.apache.ignite.ml.trainers |
Contains model trainers.
|
| org.apache.ignite.ml.trainers.transformers |
Various upstream transformers.
|
| org.apache.ignite.ml.util.generators |
Contains utility classes for data streams generation.
|
| Modifier and Type | Method and Description |
|---|---|
default UpstreamTransformerBuilder |
UpstreamTransformerBuilder.andThen(UpstreamTransformerBuilder other)
Combunes two builders (this and other respectfully)
env -> transformer1
env -> transformer2
into
env -> transformer2 . transformer1
|
static <K,V> UpstreamTransformerBuilder |
UpstreamTransformerBuilder.identity()
Returns identity upstream transformer.
|
| Modifier and Type | Method and Description |
|---|---|
default UpstreamTransformerBuilder |
UpstreamTransformerBuilder.andThen(UpstreamTransformerBuilder other)
Combunes two builders (this and other respectfully)
env -> transformer1
env -> transformer2
into
env -> transformer2 . transformer1
|
DatasetBuilder<K,V> |
DatasetBuilder.withUpstreamTransformer(UpstreamTransformerBuilder builder)
Returns new instance of
DatasetBuilder with new UpstreamTransformerBuilder added
to chain of upstream transformer builders. |
| Modifier and Type | Method and Description |
|---|---|
DatasetBuilder<K,V> |
CacheBasedDatasetBuilder.withUpstreamTransformer(UpstreamTransformerBuilder builder)
Returns new instance of
DatasetBuilder with new UpstreamTransformerBuilder added
to chain of upstream transformer builders. |
| Constructor and Description |
|---|
CacheBasedDataset(Ignite ignite,
IgniteCache<K,V> upstreamCache,
IgniteBiPredicate<K,V> filter,
UpstreamTransformerBuilder upstreamTransformerBuilder,
IgniteCache<Integer,C> datasetCache,
LearningEnvironmentBuilder envBuilder,
PartitionDataBuilder<K,V,C,D> partDataBuilder,
UUID datasetId,
boolean upstreamKeepBinary,
LearningEnvironment localLearningEnv,
int retriesCnt)
Constructs a new instance of dataset based on Ignite Cache, which is used as
upstream and as reliable storage for
partition context as well. |
CacheBasedDatasetBuilder(Ignite ignite,
IgniteCache<K,V> upstreamCache,
IgniteBiPredicate<K,V> filter,
UpstreamTransformerBuilder transformerBuilder)
Constructs a new instance of cache based dataset builder that makes
CacheBasedDataset. |
CacheBasedDatasetBuilder(Ignite ignite,
IgniteCache<K,V> upstreamCache,
IgniteBiPredicate<K,V> filter,
UpstreamTransformerBuilder transformerBuilder,
Boolean isKeepBinary,
int retries)
Constructs a new instance of cache based dataset builder that makes
CacheBasedDataset. |
| Modifier and Type | Method and Description |
|---|---|
static <K,V,C extends Serializable,D extends AutoCloseable> |
ComputeUtils.getData(Ignite ignite,
String upstreamCacheName,
IgniteBiPredicate<K,V> filter,
UpstreamTransformerBuilder transformerBuilder,
String datasetCacheName,
UUID datasetId,
PartitionDataBuilder<K,V,C,D> partDataBuilder,
LearningEnvironment env,
boolean isKeepBinary)
Extracts partition
data from the local storage, if it's not found in local storage recovers this data from a partition upstream and context. |
static <K,V,C extends Serializable> |
ComputeUtils.initContext(Ignite ignite,
String upstreamCacheName,
UpstreamTransformerBuilder transformerBuilder,
IgniteBiPredicate<K,V> filter,
String datasetCacheName,
PartitionContextBuilder<K,V,C> ctxBuilder,
LearningEnvironmentBuilder envBuilder,
int retries,
int interval,
boolean isKeepBinary,
DeployingContext deployingContext)
Initializes partition
context by loading it from a partition upstream. |
| Modifier and Type | Method and Description |
|---|---|
DatasetBuilder<K,V> |
LocalDatasetBuilder.withUpstreamTransformer(UpstreamTransformerBuilder builder)
Returns new instance of
DatasetBuilder with new UpstreamTransformerBuilder added
to chain of upstream transformer builders. |
| Constructor and Description |
|---|
LocalDatasetBuilder(Map<K,V> upstreamMap,
IgniteBiPredicate<K,V> filter,
int partitions,
UpstreamTransformerBuilder upstreamTransformerBuilder)
Constructs a new instance of local dataset builder that makes
LocalDataset. |
| Constructor and Description |
|---|
SqlDatasetBuilder(Ignite ignite,
String upstreamCache,
IgniteBiPredicate<Object,BinaryObject> filter,
UpstreamTransformerBuilder transformerBuilder)
Constructs a new instance of cache based dataset builder that makes
CacheBasedDataset. |
| Modifier and Type | Method and Description |
|---|---|
AdaptableDatasetTrainer<I,O,IW,OW,M,L> |
AdaptableDatasetTrainer.withUpstreamTransformerBuilder(UpstreamTransformerBuilder upstreamTransformerBuilder)
Specify which
UpstreamTransformerBuilder will be used. |
| Modifier and Type | Method and Description |
|---|---|
static <K,V> UpstreamTransformerBuilder |
BaggingUpstreamTransformer.builder(double subsampleRatio,
int mdlIdx)
Get builder of
BaggingUpstreamTransformer for a model with a specified index in ensemble. |
| Modifier and Type | Method and Description |
|---|---|
default DatasetBuilder<Vector,Double> |
DataStreamGenerator.asDatasetBuilder(int datasetSize,
IgniteBiPredicate<Vector,Double> filter,
int partitions,
UpstreamTransformerBuilder upstreamTransformerBuilder)
Convert first N values from stream to
DatasetBuilder. |
GridGain In-Memory Computing Platform : ver. 8.9.15 Release Date : December 3 2024