Loading…
  • Sessions appear in the color of their primary track
  • Sessions can be filtered using Products on the right
  • Use the Search bar for more flexibility
See this link for hints on how to search the schedule or sign up for sessions

View analytic
Thursday, March 22 • 9:50am - 10:40am
Ingesting streaming data into Graph database

Log in to save this to your schedule and see who's attending!

Feedback form is now closed.
This talk presents the experience of a customer project where we built a stream-based ingestion into a graph database. It is one thing to load the graph first and then querying it. But it is another story if the data to be added to the graph is constantly streaming in, while querying it. Data is easy to add, if each single message ends up as a new vertex in the graph. But if a message consists of hierarchical information, it most often means creating multiple new vertices as well adding edges to connect this information. What if a node already exists in the graph? Do we create it again or do we rather add edges which link to the existing node? Creating multiple nodes for the same real-life entity is not the best choice, so we have to check for existence first. We end up requiring multiple operations against the graph, which demonstrated to be a bottle neck. This talk presents the implementation of an ingestion pipeline and the design choice we made to improve performance.

Speakers
avatar for Guido Schmutz

Guido Schmutz

Technology Manager, Trivadis
Guido Schmutz works for the Oracle Platinum Partner Trivadis. He has more than 30 years of technology experience. At Trivadis he leads the Trivadis Architecture Board. He has long-time experience as developer, coach, trainer, and architect in the area of building IT systems. In t... Read More →


Thursday March 22, 2018 9:50am - 10:40am
3-Rm 103

Twitter Feed