Software Development Engineer II (Backend) - Ads Data

📋 Description

• • Architect and own petabyte-scale data pipelines that fuel every rupee of ad revenue on JioStar’s network, which reaches 750 million viewers weekly. Your code will directly influence how ads are targeted, delivered, and measured across live IPL matches, blockbuster premieres, and hyper-personalized VOD streams.
• • Design end-to-end batch and streaming workflows using Apache Spark (batch & structured streaming), Kafka, Hive, and Scala to ingest, transform, and serve 100+ billion events per day with sub-minute freshness guarantees.
• • Optimize storage and compute layers for cost, latency, and reliability—tuning Parquet/ORC layouts, rewriting Spark SQL plans, and leveraging Delta Lake features to cut query times by 40 % while keeping AWS EMR/GCP costs flat.
• • Build rock-solid data contracts, schemas, and lineage documentation so that data scientists, product managers, and finance teams can trust every metric—from impression counts to multi-touch attribution—without second-guessing the source.
• • Partner with real-time bidding, campaign management, and experimentation teams to expose high-quality datasets and REST/gRPC APIs that enable audience segmentation, budget pacing, and incrementality tests at the speed of live sports.
• • Implement automated quality checks, anomaly detection, and SLA monitors that catch schema drifts, volume spikes, or late-arriving events before they hit dashboards or billing systems.
• • Champion data governance, security, and compliance (GDPR, India DPDP) by integrating encryption, PII tokenization, and fine-grained access controls into every pipeline stage.
• • Continuously evaluate and adopt emerging tech—whether it’s Databricks Photon, Flink, or Lakehouse Federation—to keep the Ads Data platform two steps ahead of exploding scale and business ambition.
• • Debug and firefight production incidents in real time, performing root-cause analyses that prevent recurrence and turn every outage into a learning opportunity for the broader org.
• • Mentor junior engineers through code reviews, design sessions, and brown-bag talks, raising the technical bar of the entire backend chapter while fostering an inclusive, blameless culture.