Senior Python/PySpark developer

Project description

We are looking for a senior Python developer to join our client's team and lead the build of a new data and application platform. The team focuses on clean code, agile methodologies, and high-quality delivery. The client is from the investment banking industry.

Responsibilities

• Design, develop, and maintain scalable back-end services and APIs using Python Build and optimize data pipelines and workloads on Databricks Design, implement, and maintain CI/CD pipelines and release processes in Azure DevOps Advise and guide the team on architecture, design decisions, and best practices while the new platform is built Mentor developers and raise the technical level of the team through code reviews and pair programming Define and consume RESTful APIs, clearly communicating requirements and constraints across teams Translate business and product requirements into robust technical solutions Apply clean code principles and contribute to continuous improvement of engineering standards and tooling Write and maintain automated tests (unit, integration) Participate actively in agile ceremonies (Scrum/Kanban), including refinement, planning, reviews, and retrospectives Work closely with QA, product managers, and architects to ensure high-quality, business-aligned deliveries Support and improve existing applications in a fast-paced, enterprise investment-banking environment

SKILLS

Must have

• At least 8 years of professional software development experience, including long-term projects Strong hands-on Python development skills Hands-on experience with PySpark and distributed data processing Proven experience designing, building and maintaining ETL pipelines Hands-on experience with Databricks Experience in automated testing of data pipelines and applications Clean coding skills Excellent problem-solving skills Familiarity with agile practices (Scrum, Kanban, etc.) Good communication skills and the ability to state requirements clearly to other teams

Nice to have

Hands-on experience with Oracle, including strong SQL skills and query and performance tuning Good working knowledge of Unix/Linux and shell scripting Experience scheduling and monitoring batch jobs with Autosys Background in Java or C# development