Mid-Level Data Engineer (Temporary)

📋 Description

• • We are seeking a highly skilled and motivated Mid-Level Data Engineer to join our team on a temporary, full-time basis for a critical project focused on modernizing our serverless infrastructure and ensuring compliance with upcoming AWS deprecation timelines.
• • This role is pivotal in supporting a significant runtime upgrade initiative, demanding a proactive approach to technical challenges and a keen eye for detail. You will be instrumental in transitioning multiple production services from their current Python 3.9 runtime to the more advanced Python 3.13, ensuring seamless operation and enhanced performance.
• • A core responsibility will involve the modernization of our Serverless Framework infrastructure, specifically upgrading from v3 to v4. This includes meticulously updating dependencies and ensuring compatibility with the latest best practices and security standards.
• • You will also play a key role in identifying and safely decommissioning legacy services that are no longer required or are being replaced by the new architecture. This requires careful planning and execution to avoid any disruption to ongoing operations.
• • The project is time-sensitive, driven by the imminent AWS Python 3.9 deprecation. Your ability to work efficiently and effectively under pressure will be crucial to meeting project deadlines and mitigating potential risks.
• • Your responsibilities will extend to maintaining and updating our existing CI/CD pipelines and deployment workflows. This involves ensuring that our automated processes for building, testing, and deploying services are robust, efficient, and up-to-date.
• • You will be responsible for rigorously testing services across development, staging, and production environments, ensuring stability and reliability before each deployment.
• • A significant part of the role will involve documenting all changes made to the infrastructure and application stack. This documentation will be vital for future maintenance, troubleshooting, and knowledge transfer.
• • Furthermore, you will be expected to provide comprehensive knowledge transfer sessions to our internal team, empowering them with the understanding and skills necessary to manage the modernized infrastructure post-project.
• • The technical environment you will be working within includes a robust serverless architecture on AWS, leveraging services such as Lambda, API Gateway, and Step Functions. You will also utilize CloudFormation for infrastructure as code and CodePipeline/CodeBuild for CI/CD.
• • On the application stack side, you will be working extensively with Python, developing and maintaining Flask-based APIs. Experience with data processing libraries like boto3, pandas, and psycopg2 will be essential for interacting with AWS services and databases.
• • For CI/CD, you will be using Bitbucket Pipelines and Docker, ensuring efficient and automated delivery of code changes.
• • This role offers a unique opportunity to work on a high-impact project, directly contributing to the technological advancement and operational stability of our production systems. Your expertise will be highly valued as we navigate this critical upgrade phase.
• • The engagement is structured as a full-time independent contractor role, operating remotely, with an initial duration of 10-12 weeks, offering potential for extension based on project needs and performance. Compensation will be provided in USD, reflecting the global nature of our talent acquisition.
• • This is an excellent opportunity for a Mid-Level Data Engineer to gain hands-on experience with cutting-edge AWS serverless technologies and contribute to a significant infrastructure modernization effort within a dynamic and forward-thinking organization.