A data-engineer for most of the last 20 years, & programmer since 1984, Thibaut still enjoys coding, and Elixir is part of that! He has implemented a wide array of data engineering systems & pipelines, and loves solving real-world problems with code.
I’ve been working on https://transport.data.gouv.fr for more than 3 years.
The idea behind this talk is to show how versatile Elixir & the BEAM are, and how they helped us implement a wide array of interesting features more easily, at a lower ops cost too.
We have a lot of stuff going on: maps with 650k points shown, real-time maps showing vehicles with 80+ sources (channels/presence), “business reverse caching proxy” to reduce the load of 3rd party servers, XML query generators with LiveView, on-demand tooling (again using LiveView), data analysis scripts with LiveBook, etc etc.
We also have a strong maintenance process in place, and I want to share how good the maintenance story is.