Data Engineer (Remote)
Description We are on a journey to help the next million creators, publishers, and companies scale and monetize their audiences. beehiiv is already home to tens of thousands of the most popular newsletters in the world, and we're only 3 years old! The company quickly achieved $1M ARR in January 2023, over $7M just a year later in January 2024, and on pace for $15M to end 2025 . Oh and the team is loaded with the some of the most talented and ambitious engineers in the industry. beehiiv is currently sending over 2B emails per month and looking to build the next world-class ad platform for publishers. We are looking for someone to help build out our nascent ad network, removing manual processes, improving analytics and performance and generally proving out our startups biggest bet. You will be a great fit if you have a well thought-out technical perspective that you balance with a practical desire to ship to customers. Were seeking a self-motivated teammate who communicates early and often, and strives for the whole team to succeed. We respect each other as individuals and know work is just one part of life; we want you to have the flexibility and support you need to achieve fulfillment in your personal and professional lives. Technologies we work with: Clickhouse Kafka Ecosystem MSK Kafka Connect Schema Registry Avro Parquet Kubernetes Docker Helm / Helmfile Kubectl or K9s Argo Workflows Rest APIs AWS S3 Networking EC2 ALB IAM Other technologies that are nice to have but not necessary: Golang Terraform Metabase Spark Apache Iceberg SnowFlake ML Engineering Ideally you will have: 35 years of professional experience in data engineering or a related role. SQL expertise Have worked with and managed production OLAP databases to power internal and/or external real time analytics. Have worked with Kafka before in capacities of both managing a cluster, and in creating real time streaming applications. Are proficient in either, Golang, Python, Ruby, or a JVM language Have experience with production deployments of services using the above languages that support a RESTful API. Have experience debugging, scaling, and troubleshooting issues Are willing to learn Ruby Solid understanding of data modeling, relational databases, and NoSQL systems. Excellent problem-solving skills and the ability to work both independently and as part of a team. Strong troubleshooting skills Nice to have: Knowledge of containerization and orchestration (e.g., Docker, Kubernetes). Familiarity with machine learning workflows and integrating data pipelines with ML models. Experience with data visualization tools Metabase and Looker. Prior exposure to streaming data technologies (e.g., Kafka, Flink). Understanding of software engineering principles and best practices. Contributions to open-source data projects or a portfolio of personal projects. Experience working on small, highly productive engineering teams Experience optimizing high throughput postgres databases Keen design eye and a passion for building great developer experiences What you will be responsible for Creating a new service to abstract database and data modeling complexity away from the main beehiiv codebase Creating, maintaining, and cleaning schema definitions for Clickhouse Building out unit and integration testing suites and frameworks for the above schema Creating internal tooling to manage Avro Schema Migrations Creating real time streaming services. Launching a Lake House architecture for both internal and external customer analytics. Load testing our system Building CI/CD Creating an overarching data model and dictionary Why beehiiv? We're remote. We believe that your best work is done where you feel safe, comfortable, and supported. Empathy, not ego. Empathy opens the door to problem solving. Our team is uniquely talented and we can solve any problem when we lead with empathy. Bias towards action. Most decisions can be changed or altered, but progress cannot be created without action. It is almost always better to deliver something today over something that may be better tomorrow. Complete transparency. You will have full access to business metrics about the company. Owner-attitude. Ownership creates a sense of pride and accountability. It empowers someone to stand up for what is right, with a long-term outlook. We'll take care of you Competitive salary Stock Options Health, Dental, and Vision Insurance 401(k) employer match Unlimited PTO (mandatory 10 days per year minimum) Annual in-person team retreat Unlimited book budget Monthly Wellness Days (every third Friday!) About beehiiv We're empowering creators to create, monetize, and grow by building the most powerful and robust newsletter platform, built by newsletter people. And we're only just getting started beehiiv is committed to a diverse and inclusive workplace. beehiiv is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. Apply Job!