Software Engineer II - Connector Engineering

📋 Description

• • Architect and own the next generation of Arcadia’s data ingestion layer, building resilient, scalable connectors that pull utility data from thousands of electric, gas, and water providers across North America. You will design systems that process millions of meter reads per day, ensuring sub-minute freshness for downstream analytics, billing, and carbon accounting products.
• • Write clean, idiomatic Python (FastAPI, asyncio) and TypeScript (Node.js) services that abstract away the quirks of legacy utility portals, EDI formats, and proprietary APIs. Your code will translate cryptic CSVs, XML feeds, and web-scraped HTML into a single, normalized data model that powers Arcadia Platform and our white-label partners.
• • Lead the full SDLC for connector features: from technical design docs and threat-modeling sessions through CI/CD pipelines (GitHub Actions, Terraform, Kubernetes on EKS) to production monitoring (Datadog, SLOs, error budgets). You will ship to prod multiple times per week with zero-downtime blue/green deploys.
• • Collaborate daily with product managers, utility partnerships, and regulatory teams to prioritize new integrations based on customer impact and decarbonization potential. You will translate ambiguous utility specs into actionable engineering tasks, de-risk timelines, and communicate trade-offs clearly to non-technical stakeholders.
• • Champion observability and reliability best practices: build circuit-breakers, exponential back-off, and idempotent retries so that a single utility outage never cascades. You will set SLAs (e.g., 99.9 % data completeness within 15 min) and own the on-call rotation that keeps them.
• • Contribute to our open-source Python SDK for utility data, writing extensible parsers and documentation that external developers use to build their own climate-tech apps. You will review community PRs, shepherd major releases, and speak at meetups or conferences.
• • Mentor junior engineers through pair programming, design reviews, and career-growth plans. You will foster a blameless culture where experiments, post-mortems, and learning are celebrated.
• • Stay ahead of the regulatory curve—NERC CIP, Green Button, NAESB standards—and proactively refactor connectors to remain compliant while minimizing customer friction.
• • Optimize cost and carbon footprint of our cloud workloads by tuning autoscaling policies, adopting Graviton instances, and leveraging Spot where safe. You will quantify energy saved per code change and share results company-wide.
• • Experiment with emerging tools—vectorized parsing, Rust micro-services, LLM-assisted data validation—to keep Arcadia at the cutting edge of climate tech infrastructure.