• Sessions appear in the color of their primary track
  • Sessions can be filtered using Products on the right
  • Use the Search bar for more flexibility
See this link for hints on how to search the schedule or sign up for sessions
Wednesday, March 21 • 2:20pm - 3:10pm
Real Time Big Data Analytic Platform with Oracle GoldenGate for Big Data
Feedback form is now closed.
Lending Club’s Big Data Analytics platform is going through a major transformation to adopt the Lambda Architecture with Real-Time reporting and execution of AI/ML models on Real-Time data. Lending Club's OLTP platform is transitioning to a Microservice-based architecture. At the heart of both solutions is GoldenGate for BigData. We are using a single server configured to run the replicats serving JSON payloads and Avro formats using same set of trail files. We implemented a custom java replicat to stream JSON messages to AWS Kinesis. We are using HDFS handler to stream data in Avro format to HDFS and AWS S3 to be consumed by AWS EMR, Hive on Tez/Presto/Spark. The solutions have been architected in a secure, reliable, and resilient manner.

avatar for Vengata Guruswamy

Vengata Guruswamy

Principal Database Administrator, LendingClub Inc
Venky Guruswamy is a seasoned database professional with over 15 years of progressive experience in various tech domains of banking, financial, retail, ecommerce primarily managing Oracle, Mysql, MongoDB ,Teradata databases. He is currently the Principal DBA at Lending Club leading... Read More →
avatar for Rajit Saha

Rajit Saha

Principal Software Engineer - BigData, LendingClub
Bigdata evangelist , having well round experience in BigData stack and building BigData platform from zero to production class.

Wednesday March 21, 2018 2:20pm - 3:10pm PDT
2-Rm 102