A Rivian Data Adventure
Deez Watts, Powered by Databricks, Kubernetes, Python and the Open Road
Hello, Friends.
In case of adventure, make it a data adventure, one aimed at generating actionable (but mostly fun) insights from diverse data sources surrounding the fully connected Rivian driving experience. This will be a year long program that implements a live data streaming infrastructure and captures data emissions from a vehicle that doesn't have any emissions otherwise. Its not a startup or open source project, its an insights generation program of multiple passions slammed together in nerd format.
Rules of the Road
This is going to be fun, but the technical implementation of the Databricks Workload/K8s Configuration will be taken seriously and to an affordable best practice.
It will Spark (no pun intended, multiple fronts) professional growth by providing a dead simple data subject at the center only hindered by the high possibility of 429's.
Timeline
Ok, so yeah, I think I've got enough to get started and share publicly but realistically Ill need to put some cycles into efficiencies with the streaming workload to avoid going broke before I turn it up 24/7. So how I want to handle it is target March 2024 as a "go-live" and see how far we get with a goal of the end of November in 2024 so we can release our own version of "wrapped" or alternatively keep the innovation rolling.
Deez Watts is an Official Rivian Data Adventure, "Driven" by community, my whip, my laptop, my data, and a man with mostly good intentions... but unofficially a Rivian Jam.
Last updated
