Trait

org.apache.predictionio.core

SelfCleaningDataSource

Related Doc: package core

Permalink

trait SelfCleaningDataSource extends AnyRef

:: DeveloperApi :: Base class of cleaned data source.

A cleaned data source consists tools for cleaning events that happened earlier that specified duration in seconds from train moment. Also it can remove duplicates and compress properties(flat set/unset events to one)

Annotations
@DeveloperApi()
Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SelfCleaningDataSource
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def appName: String

    Permalink

    :: DeveloperApi :: Current App name which events will be cleaned.

    :: DeveloperApi :: Current App name which events will be cleaned.

    returns

    App name

    Annotations
    @DeveloperApi()

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. implicit object DateTimeOrdering extends Ordering[DateTime]

    Permalink
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def cleanLEvents(): Iterable[Event]

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Filters most recent, compress properties of LEvents

    Annotations
    @DeveloperApi()
  7. def cleanPEvents(sc: SparkContext): RDD[Event]

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Filters most recent, compress properties of PEvents

    Annotations
    @DeveloperApi()
  8. def cleanPersistedLEvents: Unit

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Filters most recent, compress properties and removes duplicates of LEvents

    returns

    Iterator[Event] most recent LEvents

    Annotations
    @DeveloperApi()
  9. def cleanPersistedPEvents(sc: SparkContext): Unit

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Filters most recent, compress properties and removes duplicates of PEvents

    returns

    RDD[Event] most recent PEvents

    Annotations
    @DeveloperApi()
  10. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. def compressLProperties(events: Iterable[Event]): Iterable[Event]

    Permalink
  12. def compressPProperties(sc: SparkContext, rdd: RDD[Event]): RDD[Event]

    Permalink
  13. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  14. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  15. def eventWindow: Option[EventWindow]

    Permalink

    :: DeveloperApi :: Param list that used for cleanup.

    :: DeveloperApi :: Param list that used for cleanup.

    returns

    current event windows that will be used to clean up events.

    Annotations
    @DeveloperApi()
  16. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  18. def getCleanedLEvents(lEvents: Iterable[Event]): Iterable[Event]

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Returns Iterator of events happened after duration in event window params.

    returns

    Iterator[Event] most recent LEvents.

    Annotations
    @DeveloperApi()
  19. def getCleanedPEvents(pEvents: RDD[Event]): RDD[Event]

    Permalink

    :: DeveloperApi ::

    :: DeveloperApi ::

    Returns RDD of events happened after duration in event window params.

    returns

    RDD[Event] most recent PEvents.

    Annotations
    @DeveloperApi()
  20. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  21. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  22. lazy val logger: Logger

    Permalink
  23. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  24. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  25. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  26. def recreateEvent(x: Event, eventId: Option[String], creationTime: DateTime): Event

    Permalink
  27. def removeEvents(eventsToRemove: Set[String], appId: Int): Unit

    Permalink
  28. def removeLDuplicates(ls: Iterable[Event]): Iterable[Event]

    Permalink
  29. def removePDuplicates(sc: SparkContext, rdd: RDD[Event]): RDD[Event]

    Permalink
  30. def removePEvents(eventsToRemove: RDD[String], appId: Int, sc: SparkContext): Unit

    Permalink
  31. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  32. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  33. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  35. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  36. def wipe(newEvents: Set[Event], eventsToRemove: Set[String]): Unit

    Permalink

    Replace events in Event Store

    Replace events in Event Store

    newEvents

    new events

    eventsToRemove

    event ids to remove

  37. def wipePEvents(newEvents: RDD[Event], eventsToRemove: RDD[String], sc: SparkContext): Unit

    Permalink

    Replace events in Event Store

Inherited from AnyRef

Inherited from Any

Ungrouped