Software Engineer - Public Sector

📋 Description

• • Architect and own the technical vision for mission-critical data pipelines that ingest, transform, and route billions of unstructured documents (PDFs, Word, HTML, images, audio, video) for federal agencies and defense organizations, ensuring 99.99 % uptime and sub-second latency under strict security constraints.
• • Design and implement secure, scalable, and compliant data orchestration systems that run on classified networks (IL5/IL6, JWICS, SIPRNet) while integrating with existing agency toolchains and legacy mainframes, using Python, Go, and Rust micro-services deployed via Kubernetes on AWS GovCloud, Azure Government, or GCP FedRAMP High.
• • Lead cross-functional squads of backend, DevOps, security, and data engineers to deliver end-to-end features—from threat-modeling and ATO documentation to CI/CD hardening and chaos-engineering drills—ensuring every release meets FedRAMP, FISMA, NIST 800-53, and DoD 8570 controls.
• • Optimize distributed ingestion engines that process 10 TB+ daily, leveraging GPU-accelerated OCR, NLP transformers, and vector databases to convert raw files into LLM-ready embeddings while enforcing zero-trust encryption, role-based access, and tamper-evident audit trails.
• • Build real-time observability stacks (Prometheus, Grafana, OpenTelemetry) that surface security anomalies, performance regressions, and cost spikes to agency stakeholders within seconds, enabling proactive remediation before mission impact.
• • Mentor junior engineers on secure-coding practices, threat modeling, and incident response, while conducting architecture reviews and brown-bag sessions that raise the bar for code quality, documentation, and compliance across the federal practice.
• • Partner directly with agency program managers, CISOs, and data scientists to translate evolving mission requirements into technical roadmaps, sprint plans, and measurable OKRs that align engineering velocity with national security priorities.
• • Contribute back to the open-source community by upstreaming hardened libraries, compliance automation scripts, and performance benchmarks, amplifying Unstructured’s 36 million download footprint and reinforcing our reputation as the de-facto standard for unstructured data ingestion.
• • Travel up to 20 % to customer sites, SCIFs, and field operations for user research, security reviews, and on-site deployments—turning whiteboard sketches into production systems that analysts, warfighters, and policymakers rely on every day.
• • Champion a culture of continuous improvement by running blameless post-mortems, A/B performance experiments, and cost-optimization sprints that reduce cloud spend per document by double-digit percentages quarter-over-quarter.