Job Overview
Location
United States
Job Type
Full-time
Category
Data Engineer
Date Posted
May 21, 2026
Full Job Description
đź“‹ Description
- • Serve as a trusted technical advisor to financial services clients, guiding them through data architecture and engineering needs using Databricks solutions, with equal time spent on billable project delivery and pre-sales activities.
- • Design, build, and deploy end-to-end data solutions that capture, transform, and leverage data for AI, machine learning, and business intelligence initiatives, ensuring scalability, security, and performance.
- • Collaborate directly with sales teams to present technical architectures to prospective clients, demonstrating the value of SunnyData’s Databricks-based offerings through compelling demonstrations and tailored solution narratives.
- • Manage multiple concurrent customer engagements, tracking project progress, ensuring on-time delivery, and reporting measurable outcomes to both internal stakeholders and clients.
- • Architect data solutions incorporating industry best practices in data governance, security, quality, and lineage, with explicit attention to regulatory compliance in banking and financial services environments.
- • Evaluate diverse data sources for analytical viability and recommend strategic data inclusion policies to enhance data quality and analytical output.
- • Lead cross-functional teams of data engineers and analysts, providing technical direction, mentoring junior staff, and educating end users on data products and analytic environments.
- • Perform system analysis to identify, assess, and resolve data pipeline defects, system errors, and integration failures, applying corrective measures to maintain solution integrity.
- • Conduct rigorous testing of data movement, transformation logic, and system components to ensure accuracy, reliability, and operational stability across all data layers.
- • Develop comprehensive solution documentation including proof-of-concept (POC) reports, technical roadmaps, sequence diagrams, class hierarchies, and logical system views for client and internal use.
- • Translate complex client requirements into detailed architectural blueprints that can be implemented by engineering and analytics teams, leading discovery sessions and solution design workshops.
- • Optimize SQL queries for performance, debug data workflows, and ensure efficient data retrieval and transformation across relational and non-relational systems.
- • Implement and maintain automated data pipelines using tools such as dbt, Spark Streaming, and cloud-native orchestration platforms to enable continuous data curation and transformation.
- • Apply expertise in cloud platforms (AWS, Azure, GCP) to architect secure, scalable, and cost-effective data solutions aligned with client infrastructure strategies.
- • Support the full software development lifecycle—from initial design and documentation through implementation, testing, and deployment—ensuring robust and maintainable data systems.
🎯 Requirements
- • 7+ years as a hands-on Solutions Architect and/or Senior Data Engineer with recent, direct experience implementing data solutions using Databricks
- • Expertise in Data Engineering technologies (Spark, Hadoop, Kafka), Databricks platform, and ML/data science frameworks (pandas, scikit-learn)
- • Proficiency in Python, Java, and/or Scala, with advanced SQL skills to write, debug, and optimize queries
- • Demonstrated experience with cloud platforms: AWS, Azure, and/or GCP
- • Strong client-facing communication and presentation skills, with proven ability to deliver technical presentations to stakeholders
- • Experience leading teams, mentoring engineers, and managing end-to-end solution delivery into production
🏖️ Benefits
- • Health insurance coverage for employees and eligible family members (spouses, domestic partners, children) starting on the first day of employment
- • Minimum 15 days of Paid Time Off annually, plus nine paid company holidays
- • Opportunities for professional growth through leadership on innovative, cutting-edge customer projects in data engineering and AI
- • Performance-based cash incentive awards as part of comprehensive compensation package
Skills & Technologies
Python
Java
Scala
Elasticsearch
Cassandra
Senior
Onsite
Degree Required
About SunnyData Inc.
SunnyData provides AI-driven data analytics and business intelligence software to enterprises. Its cloud platform ingests, cleans, and analyzes structured and unstructured data from CRM, ERP, IoT, and social sources, delivering interactive dashboards, predictive models, and automated reporting. Machine-learning algorithms surface anomalies, forecast demand, and recommend actions. APIs and pre-built connectors integrate with Salesforce, Snowflake, AWS, and Azure. The company serves retail, manufacturing, healthcare, and financial services clients seeking faster, data-driven decisions without building in-house infrastructure.
Get more remote jobs like this
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
