Senior Software Engineer - Clickpipes (CDC/Streaming)

<p style="min-height:1.5em"><strong>Note:</strong>. We are hiring for this role remotely in any country ClickHouse has a hiring presence.</p><h3>About the Team</h3><p style="min-height:1.5em">The <strong>ClickPipes - Database Integrations</strong> team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale.</p><p style="min-height:1.5em">As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on <a target="_blank" rel="noopener noreferrer nofollow" href="https://github.com/PeerDB-io/peerdb">PeerDB</a>, an open-source CDC platform we actively maintain and contribute to.</p><p style="min-height:1.5em">See some of our recent work:</p><ul style="min-height:1.5em"><li><p style="min-height:1.5em"><a target="_blank" rel="noopener noreferrer nofollow" href="https://clickhouse.com/blog/clickpipes-postgres-failover-replication">ClickPipes for Postgres now supports failover replication slots</a></p></li><li><p style="min-height:1.5em"><a target="_blank" rel="noopener noreferrer nofollow" href="https://clickhouse.com/blog/mongodb-cdc-clickhouse-preview">MongoDB CDC to ClickHouse with Native JSON Support</a></p></li><li><p style="min-height:1.5em"><a target="_blank" rel="noopener noreferrer nofollow" href="https://clickhouse.com/blog/building-msql-change-data-capture-in-clickpipes">Under the Hood: Building MySQL Change Data Capture in ClickPipes</a></p></li></ul><h3><strong>What You’ll Do:</strong></h3><ul style="min-height:1.5em"><li><p style="min-height:1.5em"><strong>Build data-intensive systems</strong></p><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).</p></li><li><p style="min-height:1.5em">Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.</p></li><li><p style="min-height:1.5em">Design integration solutions to enable users to fully harness ClickHouse's performance and throughput.</p></li></ul><p style="min-height:1.5em"><strong>Own end-to-end reliability</strong></p><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing).</p></li><li><p style="min-height:1.5em">Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.</p></li><li><p style="min-height:1.5em">Write clear documentation, both publicly and internally.</p></li><li><p style="min-height:1.5em">Participate in on-call rotation.</p></li></ul><p style="min-height:1.5em"><strong>Drive product innovation</strong></p><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Work directly with customers to understand integration requirements and discover gaps in existing product.</p></li><li><p style="min-height:1.5em">Collaborate cross-functionally with internal teams to ensure operational efficiency.</p></li><li><p style="min-height:1.5em">Lead technical discussions and influence product roadmaps.</p></li></ul></li></ul><h3><strong>About You:</strong></h3><ul style="min-height:1.5em"><li><p style="min-height:1.5em">5+ years of industry experience building data-intensive software solutions.</p></li><li><p style="min-height:1.5em">Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go.</p></li><li><p style="min-height:1.5em">Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure).</p></li><li><p style="min-height:1.5em">Practical experience with Kubernetes.</p></li><li><p style="min-height:1.5em">Strong problem solver and solid production debugging skills.</p></li><li><p style="min-height:1.5em">Clear communication in writing (design docs, code review) and verbally (technical discussions, customer calls, incident response).</p></li></ul><p style="min-height:1.5em"><strong>Bonus Points</strong></p><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Experience with database replication technologies (CDC, logical replication).</p></li><li><p style="min-height:1.5em">Experience with durable execution frameworks (Temporal).</p></li><li><p style="min-height:1.5em">Experience with data formats and protocols (Avro, Parquet, Protobuf).</p></li><li><p style="min-height:1.5em">Experience with modern data processing frameworks (e.g. Kafka, Spark, Flink).</p></li><li><p style="min-height:1.5em">Experience with maintaining/contributing to open-source software.</p></li></ul><h3><strong>Why Join Us</strong></h3><ul style="min-height:1.5em"><li><p style="min-height:1.5em">Work on challenging problems at the intersection of database technologies, distributed systems, and cloud-native architecture.</p></li><li><p style="min-height:1.5em">Work on a team that builds software in the open (<a target="_blank" rel="noopener noreferrer nofollow" href="https://github.com/PeerDB-io/peerdb">PeerDB</a>), and that cares about the craft of engineering, documentations, and continuous learning.</p></li><li><p style="min-height:1.5em">Be part of a high-visibility team that delivers meaningful impact to customers in a dynamic, hyper-growth environment.</p></li></ul><p style="min-height:1.5em">#LI-remote</p><h3><strong>Perks</strong></h3><ul style="min-height:1.5em"><li><p style="min-height:1.5em"><strong>Flexible work environment</strong> - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 25 countries.</p></li><li><p style="min-height:1.5em"><strong>Healthcare</strong> - Employer contributions towards your healthcare.</p></li><li><p style="min-height:1.5em"><strong>Equity in the company</strong> - Every new team member who joins our company receives stock options.</p></li><li><p style="min-height:1.5em"><strong>Time off</strong> - Flexible time off in the US, generous entitlement in other countries.</p></li><li><p style="min-height:1.5em"><strong>A USD$500 Home office setup </strong>if you’re a remote employee.</p></li><li><p style="min-height:1.5em"><strong>Global Gatherings </strong>– We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites.</p></li></ul><h3>Culture - We All Shape It</h3><p style="min-height:1.5em">As part of a rapidly scaling start-up, you will be instrumental in shaping our culture.</p><p style="min-height:1.5em">Are you interested in finding out more about our culture? Learn more about our values <a target="_blank" rel="noopener noreferrer nofollow" href="https://clickhouse.com/company/careers">here</a>. Check out our<a target="_blank" rel="noopener noreferrer nofollow" href="https://clickhouse.com/blog"> blog posts</a> or follow us on <a target="_blank" rel="noopener noreferrer nofollow" href="https://www.linkedin.com/company/clickhouseinc/life/0c1ee7f4-2129-488d-b413-e7f6270659fd/?viewAsMember=true">LinkedIn</a> to find out more about what’s happening at ClickHouse.</p><h3>Equal Opportunity &amp; Privacy</h3><p style="min-height:1.5em">ClickHouse provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any type based on factors such as race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.</p><p style="min-height:1.5em">Please see <a target="_blank" rel="noopener noreferrer nofollow" href="https://clickhouse.com/legal/applicant-privacy-notice">here</a> for our Privacy Statement.</p><p>Find <a href="https://www.arbeitnow.com">Jobs in Germany</a> on Arbeitnow</a>