Software Engineer - Golang (Data Platform)

📋 Description

• • Architect and maintain the beating heart of Insider One’s global data platform, writing highly-concurrent, low-latency Go services that ingest, transform, and serve more than 2.2 billion requests and 2 billion real-time notifications every single day to 450+ production servers.
• • Own the end-to-end lifecycle of critical data pipelines—from design and code reviews to automated testing, deployment, and 24×7 production monitoring—ensuring sub-second latency and five-nines reliability for thousands of enterprise customers including Samsung, Nike, L’Oréal, Singapore Airlines, Nestlé, and IKEA.
• • Collaborate daily with product managers, data scientists, and fellow engineers in agile squads to translate ambitious product road-maps into rock-solid distributed systems, leveraging event-driven architectures, streaming pipelines, and gRPC-based micro-services.
• • Optimize concurrency patterns, memory management, and I/O throughput in Go, squeezing every last millisecond out of high-traffic endpoints while keeping CPU and memory footprints minimal; every 1 % gain you deliver is multiplied by billions of events.
• • Design bullet-proof data models in MySQL/PostgreSQL, craft Redis caching layers, and tune ClickHouse analytical stores to support both real-time personalization and petabyte-scale historical analytics on 100 TB of AI training data.
• • Build self-healing infrastructure on AWS with Kubernetes, automating blue-green deployments, auto-scaling, chaos testing, and observability dashboards so the platform recovers gracefully under traffic spikes or regional outages.
• • Champion clean-code practices: write idiomatic Go, enforce rigorous unit/integration tests, maintain >80 % coverage, and document complex algorithms so any teammate can ramp up in hours, not weeks.
• • Debug elusive distributed bugs—race conditions, network partitions, or data-skew hotspots—using distributed tracing, structured logging, and metrics; turn root-cause analyses into actionable post-mortems that prevent recurrence.
• • Continuously experiment with emerging technologies (Kafka, NATS, Kinesis, ClickHouse, vectorized query engines) and run proof-of-concepts that could shave seconds off batch windows or cut cloud costs by double-digit percentages.
• • Present technical deep-dives to the broader engineering org during Tech & Dev Talks, mentor junior developers through pair programming and code reviews, and influence architectural decisions that will shape the platform for the next decade.
• • Contribute to open-source Go libraries and internal SDKs that standardize data contracts, serialization, and observability across 30 global offices and 50 nationalities, fostering a culture of shared ownership and relentless innovation.
• • Participate in on-call rotations with a blameless culture, using SLOs, error budgets, and chaos engineering to turn incidents into learning opportunities that make the system—and the team—stronger every week.