Senior Data Engineer (Databricks on Azure)

Worldwide | Oct. 20, 2026

Report as Closed

Company: Devsu

Country: Worldwide

Type: Remote

Employment: Full-time

Description: Build innovative digital products. A career that fits your calling and offers a new challenge every day.

With over 10 years of experience driving innovation for companies ranging from startups to large corporations in the United States and Latin America, Devsu has developed high-impact solutions in industries such as entertainment, banking, healthcare, retail, education, and insurance.

At Devsu, you'll work alongside top-tier professionals, with the opportunity for continuous learning and participation in challenging, high-impact projects for global clients. Our team is present in more than 18 countries, collaborating on a variety of software products and solutions.

Our client, an AI-powered financial technology company, is looking for an Engineering Manager. The company automates data extraction and financial modeling for investment professionals. They deliver accurate, auditable data and modern workflows to help analysts spend less time on rote work and more time on insight.

Must Have

• 5+ years of experience in data engineering.
• Strong Python development skills.
• Solid experience with Apache Spark and PySpark.
• Advanced, hands-on production experience with Azure Databricks, including Delta Lake, Unity Catalog, Workflows/Jobs, ADLS Gen2, and Azure Data Factory.
• Strong SQL and data modeling skills.
• Proven experience building, testing, deploying, and troubleshooting production ETL/ELT pipelines.
• Experience with Git-based version control and CI/CD pipelines, such as Azure DevOps.
• Experience integrating REST APIs for data ingestion, including authentication, pagination, and error handling.
• Experience writing automated tests for data pipelines.
• Strong understanding of data quality, reliability, and data engineering best practices.
• Strong analytical, problem-solving, communication, and collaboration skills, with the ability to evaluate unfamiliar codebases, identify trade-offs, challenge assumptions, and recommend practical improvements.

With over 10 years of experience driving innovation for companies across the United States and Latin America, Devsu delivers software development and digital transformation solutions across multiple industries.

At Devsu, you'll collaborate with talented professionals across more than 18 countries, contribute to challenging technology projects, and grow professionally.

We are looking for a Senior Data Engineer to join our team and design, build, and modernize scalable data solutions using Python, Apache Spark, and Azure Databricks. You'll help improve data pipeline performance, reliability, and automation while contributing to high-quality software solutions for our clients.

As a Senior Data Engineer, you'll design, build, modernize, and operate scalable data pipelines using Python, Apache Spark, PySpark, and Azure Databricks. You'll take ownership of production data workflows, improve system reliability, and collaborate with technical and business teams to deliver robust data solutions.

• Design, build, and maintain scalable data pipelines using Python, Apache Spark, PySpark, and Azure Databricks.
• Modernize legacy data processing workloads and migrate them to secure, cloud-native platforms.
• Build batch ingestion pipelines for structured and unstructured data.
• Integrate data from REST APIs, SharePoint, document repositories, enterprise applications, and cloud platforms.
• Implement data quality controls, monitoring, observability, and operational safeguards.
• Optimize pipelines for performance, scalability, reliability, and cost efficiency.
• Develop document extraction, classification, metadata enrichment, and automation workflows.
• Apply software engineering practices, including Git, CI/CD, automated testing, and code reviews.
• Deploy, troubleshoot, and maintain production ETL/ELT pipelines.
• Collaborate with architects, developers, business subject matter experts, and platform teams.
• Analyze existing codebases, identify technical risks and trade-offs, and propose practical improvements.
• Use AI-assisted development tools to support data pipeline development, testing, and maintenance.

At Devsu, we strive to create an environment where you can thrive both personally and professionally. By joining our team, you'll enjoy:

• A stable, long-term contract with opportunities for professional growth.
• Private health insurance.
• Ongoing training, mentorship, and learning opportunities to help you stay at the forefront of the industry.
• Free access to AI training resources and cutting-edge AI tools to enhance your daily work.
• Flexible paid time off (PTO) in addition to paid holidays.
• Challenging, world-class software projects for clients across the United States and Latin America.
• The opportunity to collaborate with talented software engineers across Latin America and the United States in a diverse work environment.

Join Devsu and discover a workplace that values your growth, supports your well-being, and empowers you to make a global impact.

• Experience modernizing legacy data pipelines.
• Experience with document processing, intelligent document extraction, or unstructured data.
• Familiarity with AI-assisted development tools such as Codex, GitHub Copilot, or similar.
• Experience with streaming data pipelines or large-scale data repositories.

Apply here:

Web: Apply here

Emails: