CORAL WIKI

Architecture

Here are some of the processing we perform in our real-time analytics pipeline:

• Enrichment - Decorate events with additional attributes. For example, we can add Geo location information to user interaction events based on the IP address range
• Filtering and Mutation - Filter out irrelevant attributes, events or transform content of a event
• Aggregation - Count number of events or add up metrics along a set of dimensions over a time window
• Stateful Processing - Group multiple events into one or generate a new event based on a sequence of events and processing rules.

Coral dataflows can be integrated with different systems. For example, summarized events can be sent to a persistent metric stores to support ad-hoc queries. Events can also be sent to some form of visualization dashboard for real-time reportings or backend systems that can react to event signals.