Astyra is seeking a Python Data Engineer to support a technology initiative with one of our long-standing financial services clients. This individual will join an established engineering team supporting a real-time data platform and the data pipelines and infrastructure surrounding it.
The Python Data Engineer will focus on building, automating, and improving data ingestion and ETL processes, including integrating historical data from external systems into the client’s technology ecosystem. The ideal candidate will have strong hands-on experience with Python, PySpark, AWS Glue, Spark, and data pipelines and be comfortable working independently within an established engineering team.
Responsibilities
- Design, develop, automate, and support Python-based data pipelines and ETL processes
- Ingest, transform, and integrate data from external source systems into the client’s technology ecosystem
- Develop and maintain data processing solutions using Python, PySpark, AWS Glue, and Spark
- Automate and improve existing data ingestion and conversion processes
- Build and maintain backend infrastructure and pipelines supporting existing real-time data models
- Support platform stability, including technical and network-related upgrades
- Work independently while collaborating closely with the Tech Lead and other engineers
- Proactively identify and communicate technical risks, issues, and opportunities for improvement
- Develop maintainable code and participate in testing and code reviews
Basic Qualifications
- At least 3 years of experience in software development, data engineering, or application development
- Experience developing applications and/or data pipelines using Python
- Experience with PySpark and Spark
- Experience with AWS, including AWS Glue
- Experience building or maintaining ETL, data ingestion, or data pipeline solutions
- Experience working with SQL
Preferred Qualifications
- 3–7+ years of relevant software or data engineering experience
- Strong hands-on experience with Python, PySpark, AWS Glue, and Spark
- Experience designing, automating, and supporting large-scale data ingestion and ETL pipelines
- Experience with asyncio or asynchronous processing in Python
- Experience with Snowflake
- Experience supporting backend infrastructure or data platforms in a production environment
- Experience working with real-time data systems
- Strong communication skills with the ability to work independently and proactively surface risks and issues
- Previous experience working within a large enterprise or financial services environment
Proper email communication will only be done to and from @astyra.com email addresses. Please ensure you are communicating with approved Astyra recruiters by checking this point when receiving offers and messages from us. Please ensure you are communicating within these guidelines and proper channels for the quickest possible interview consideration!
#AC