This event has ended. Visit the official site or create your own event on Sched.
October 23-26, 2017 - Prague, Czech Republic
Click Here For Information & Registration
Monday, October 23 • 12:05 - 12:45
Scaling Massive, Real-Time Data Pipelines with Go - Jean de Klerk, Pivotal

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Big data often means huge processing pipelines. Passing 10,000 messages a second between apps and datastores is tough. Add on filtering and parsing and you’re bound to run into problems. At Pivotal Cloud Foundry, we have to handle several factors of that load each day, which means our programs need to be highly concurrent and very careful with state. Let’s look at some patterns and best practices that can be taken advantage of in order to handle this load.

avatar for Jean de Klerk

Jean de Klerk

Senior Software Engineer, Pivotal Labs
Jean is a senior software engineer working on Pivotal's open source Cloudfoundry PaaS, building highly concurrent microservices for metrics, logs, and autoscaling. Jean's open source experience includes work on projects such as Pivotal UI, the React.js and Spring projects, several... Read More →

talk key

Monday October 23, 2017 12:05 - 12:45 CEST