246
COMPANIES
1,119
JOBS

Senior Data-Intensive Backend Engineer (Rust)

Rerun.io

Rerun.io

Software Engineering
Remote
Posted on Dec 17, 2024

Help us build the multimodal data stack

At Rerun, we’re building a new multimodal data stack for robotics and spatial AI. Large parts of the physical-world economy will be transformed by these technologies, and we're building the data infrastructure and tools that enable it to happen. Data volumes grow big quickly with these applications and performance matters everywhere; from micro interactions to high throughput jobs.

With multimodal data stack we mean tools for extraction, ingestion, storage, querying, streaming, and visualization of temporal multimodal data. Rerun’s open source project is already loved by some of the best teams in the world, and focuses on visualizing and handling multimodal logs. You'll join a newly formed team building out Rerun's commercial offering for ingesting, indexing and querying multimodal data at scale.

What you'll work on

  • You'll work on what is in essence a cloud-native analytical database system built for multimodal (often time-series) data.

    • The system is column oriented, built around Apache Arrow, and needs to support specialized query semantics to handle robotics-style multimodal logs (very sparse and wide tables) and many domain specific operators (e.g. related to 3D transforms).

      • Note: prior robotics knowledge is not necessary

    • Storage is separate from the query engine, and consists of heterogeneous file types, usually in the customer's cloud.

    • High performance queries require (among other things) building and maintaining indices into these files.

  • You'll design and implement many of the core pieces that make sure this data-intensive system is highly scalable.

We'd love it if you have

  • An ownership mindset - we're all doing this together!

  • A helpful attitude and a curious mind

  • A deep understanding of all the systems, layers, and abstractions sitting between your code and the hardware

  • A strong propensity to dig into these layers when the situation calls for it

  • Experience with async Rust in production

  • Experience building highly scalable data-intensive systems

  • Comfort with concepts like query planning, push-down filtering, and query optimization

  • Great communication skills in English - you'll be working in a tight-nit remote team

Additionally, any of these would be a bonus

  • Experience with Apache Arrow and Apache Datafusion

  • Experience with GPU workloads

  • Interest or experience in relevant domains like machine learning, robotics, AR/VR, or simulation

How we work at Rerun

  • We're a remote company headquartered in Stockholm, Sweden.

  • We meet up in person for a week roughly once a quarter

  • The team you'll join has members in European and US-east timezones

    • Everyone is available for synchronous work between 1:30 and 5pm CET

  • We've put together an uncommonly talented tech team, value agency and helpfulness highly, and expect everyone to take broad responsibility for what they build

  • We offer competitive cash and equity compensation, six weeks paid vacation, and whatever hardware and software you need to do your job