This object provides a set of operation to access Event Store without going through Spark's parallelization.
This object provides a set of operation to access Event Store without going through Spark's parallelization.
Note that blocking methods of this object uses
scala.concurrent.ExecutionContext.Implicits.global
internally.
Since this is a thread pool which has a number of threads equal to available
processors, parallelism is limited up to the number of processors.
If this limitation become bottleneck of resource usage, you can increase the number of threads by declaring following VM options before calling "pio deploy":
export JAVA_OPTS="$JAVA_OPTS \ -Dscala.concurrent.context.numThreads=1000 \ -Dscala.concurrent.context.maxThreads=1000"
You can learn more about the global execution context in the Scala documentation: https://docs.scala-lang.org/overviews/core/futures.html#the-global-execution-context
This object provides a set of operation to access Event Store with Spark's parallelization
Provides high level interfaces to the Event Store from within a prediction engine.