PentahoNL meetup March 2017 recap

Great vibe, interesting talks

We had another great PentahoNL meetup last week.

This session was hosted by Rob Smienk at the offices of @MRDM in Deventer. @MRDM is a company specialized in aggregating Medical data and registration data to gather better insights in Medical processes and treatment outcomes.

Hospitals and University Medical Centers increasingly need to report and clarify on Costs and Quality of medical treatments. They gather data from connected Hospitals, aggregate and benchmark the results. They are growing fast, moving into other European markets as we speak, and are actively seeking new keyboard cowboys.

MRDM: PDI by components

Rob Smienk

Metadata driven highly componentized etl as developed at MRDM. By building small components and glueing them together with a homemade orchestration framework these guys are able to quickly onboard new datasets by mix and matching suitable components. Highly agile, I was impressed and inspired by their approach.

MRDM: ETL testing

Rutger Deterd Oude Weme

The small components suite perfectly for TDD (Test Driven Development), it was the first group I have seen following up so strongly on TDD in the Pentaho “ecosphere”, should be applied much more (at least I’ll try to follow up on their guidelines more seriously).

Continuous Delivery of Etl, from git to carte in a (couple off) sec(s)

Rogier Wessel

I talked but mostly demo-ed our Continuous Delivery setup. We utilize the power of Docker, Apache Mesos with some help of a CI (Teamcity) to quickly build and deploy new ETL as it gets committed to git(hub).

To conclude

I think the combination of talks was very complementary, from different points of the challenge of building solid ETL we showed how to make finely grained, highly testable and quickly releasable code.

Really wonder what will be next time, hope to see you guys soon!

Rogier Wessel

Opensource Data dude, from linux to docker into the magical world of data and Pentaho. Might have eaten all red pills when it came to docker...

Amersfoort, The Netherlands https://blog.blijblijblij.com