Senior Data-Intensive Backend Engineer (Rust)
Rerun.io
Help us build the multimodal data stack
At Rerun, we’re building a new multimodal data stack for robotics and spatial AI. Large parts of the physical-world economy will be transformed by these technologies, and we're building the data infrastructure and tools that enable it to happen. Data volumes grow big quickly with these applications and performance matters everywhere; from micro interactions to high throughput jobs.
With multimodal data stack we mean tools for extraction, ingestion, storage, querying, streaming, and visualization of temporal multimodal data. Rerun’s open source project is already loved by some of the best teams in the world, and focuses on visualizing and handling multimodal logs. You'll join a newly formed team building out Rerun's commercial offering for ingesting, indexing and querying multimodal data at scale.
What you'll work on
-
You'll work on what is in essence a cloud-native analytical database system built for multimodal (often time-series) data.
-
The system is column oriented, built around Apache Arrow, and needs to support specialized query semantics to handle robotics-style multimodal logs (very sparse and wide tables) and many domain specific operators (e.g. related to 3D transforms).
Note: prior robotics knowledge is not necessary
Storage is separate from the query engine, and consists of heterogeneous file types, usually in the customer's cloud.
High performance queries require (among other things) building and maintaining indices into these files.
-
You'll design and implement many of the core pieces that make sure this data-intensive system is highly scalable.
We'd love it if you have
An ownership mindset - we're all doing this together!
A helpful attitude and a curious mind
A deep understanding of all the systems, layers, and abstractions sitting between your code and the hardware
A strong propensity to dig into these layers when the situation calls for it
Experience with async Rust in production
Experience building highly scalable data-intensive systems
Comfort with concepts like query planning, push-down filtering, and query optimization
Great communication skills in English - you'll be working in a tight-nit remote team
Additionally, any of these would be a bonus
Experience with Apache Arrow and Apache Datafusion
Experience with GPU workloads
Interest or experience in relevant domains like machine learning, robotics, AR/VR, or simulation
How we work at Rerun
We're a remote company headquartered in Stockholm, Sweden.
We meet up in person for a week roughly once a quarter
-
The team you'll join has members in European and US-east timezones
Everyone is available for synchronous work between 1:30 and 5pm CET
We've put together an uncommonly talented tech team, value agency and helpfulness highly, and expect everyone to take broad responsibility for what they build
We offer competitive cash and equity compensation, six weeks paid vacation, and whatever hardware and software you need to do your job