Technical Lead

📋 Description

• • Latamcent is seeking a highly skilled and experienced Technical Lead to spearhead the architectural vision and execution of a cutting-edge, cloud-native data engineering platform. This platform is engineered to handle immense observability workloads across diverse and distributed network domains, serving the demanding needs of the telecommunications industry. You will be instrumental in shaping a system built upon a disaggregated microservices architecture, with Kafka at its core, designed for Kubernetes-native and cloud-agnostic deployment, and continuously evolving towards sophisticated near-real-time streaming capabilities.
• • As a Technical Lead, you will be at the forefront of critical architectural decisions, guiding the development across both Go and Node.js/TypeScript technology stacks. Your responsibilities will encompass defining robust, high-throughput streaming strategies, ensuring the platform meets stringent production-grade standards for reliability, scalability, and security. This is a hands-on leadership role, ideal for an individual who thrives in the complexities of distributed systems, excels in high-scale data processing, and is deeply familiar with modern cloud-native environments. Your expertise will directly impact the performance, resilience, and future growth of a mission-critical platform.
• • ARCHITECTURE & SYSTEM DESIGN:
• • Architect and oversee the design of high-throughput, fault-tolerant Kafka-based streaming pipelines, ensuring efficient data ingestion and processing.
• • Design and implement scalable, resilient distributed microservices, leveraging both Go for performance-critical components and Node.js/TypeScript for rapid development and flexibility.
• • Define sophisticated partitioning strategies, advanced concurrency models, and effective windowed aggregation patterns to optimize data processing and latency.
• • Lead the architectural evolution towards near-real-time streaming capabilities, anticipating future demands and technological advancements.
• • Drive the strategy for scaling, enhancing reliability, and optimizing performance across all microservices, ensuring the platform can handle increasing loads without degradation.
• • Ensure the platform's deployment architecture is cloud-agnostic and Kubernetes-native, facilitating seamless operation across various cloud providers and on-premises environments.
• • STREAMING & DATA ENGINEERING:
• • Implement robust and resilient streaming patterns, including sophisticated retry mechanisms, dead-letter queues (DLQs), idempotency controls, and effective backpressure handling to ensure data integrity and system stability.
• • Design and implement forward-thinking schema evolution strategies, utilizing formats like Avro or Protobuf in conjunction with a Schema Registry to manage data structure changes gracefully without disrupting ongoing operations.
• • Build and maintain systems capable of processing an exceptionally high volume of data, targeting over 10 million messages per day, with the capacity for significant future growth.
• • Guide the implementation of dynamic configuration management using Kubernetes Custom Resource Definitions (CRDs) and operator patterns, enabling flexible and automated system management.
• • Define and enforce comprehensive observability standards, integrating tools like OpenTelemetry for metrics, logging, and distributed tracing to provide deep insights into system behavior.
• • SECURITY & PRODUCTION READINESS:
• • Ensure the adoption of secure container practices, including the generation and management of Software Bill of Materials (SBOM), diligent CVE (Common Vulnerabilities and Exposures) hygiene, and robust image hardening techniques.
• • Define and implement comprehensive CI/CD strategies that prioritize secure and reliable deployment pipelines, minimizing risks and ensuring rapid, safe releases.
• • Design and architect multi-tenant cloud-ready environments that support secure isolation and efficient resource utilization for different users or services.
• • Establish metrics-driven scaling and monitoring standards, enabling the platform to automatically adjust resources based on real-time performance data and ensuring proactive issue detection.
• • LEADERSHIP:
• • Conduct thorough architectural reviews, providing constructive feedback and mentoring junior and senior engineers to foster technical growth and best practices.
• • Guide and mentor engineering teams distributed across multiple time zones, promoting effective collaboration and knowledge sharing in a remote-first environment.
• • Collaborate effectively cross-functionally with product management, domain experts, and other stakeholders to align technical solutions with business objectives.
• • Actively bring telecom domain awareness and expertise into system design decisions, ensuring the platform meets the specific needs and challenges of the industry.