ContractData Engineer
Job Description
We are seeking an experienced Data Engineer with strong expertise in PySpark, AWS data engineering services, Databricks, Snowflake, and SQL to support data engineering initiatives for a financial services client. The ideal candidate will have hands-on experience designing and developing scalable data pipelines, building data processing solutions, and working with large datasets. Experience in dashboard development, monitoring, analytics, and financial services or risk technology environments is highly desirable.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark and AWS data engineering services.
- Build and manage ETL/ELT workflows using AWS Glue, Databricks, and other cloud-based data processing technologies.
- Develop, optimize, and maintain complex SQL queries for data extraction, transformation, and analysis.
- Work with Snowflake to manage, process, and optimize large-scale data workloads.
- Build and enhance data integration solutions to ensure data accuracy, consistency, and reliability across multiple systems.
- Monitor data pipelines, troubleshoot processing issues, and implement solutions to improve performance and reliability.
- Develop dashboards and analytical solutions to provide meaningful insights into business and operational data.
- Support monitoring and analytics initiatives by tracking data quality, pipeline performance, and key metrics.
- Collaborate with data engineering, analytics, risk technology, and business teams to understand requirements and deliver effective data solutions.
- Ensure data processing practices align with security, governance, and compliance standards within the financial services environment.
Required Skills and Qualifications
- Strong hands-on experience with PySpark, with the ability to develop and optimize distributed data processing applications.
- Practical experience with AWS Glue for data integration, ETL development, and workflow orchestration.
- Experience working with Databricks for large-scale data processing and transformation.
- Strong knowledge of Snowflake and cloud-based data warehousing concepts.
- Advanced SQL skills, including complex queries, joins, aggregations, and performance optimization.
- Experience designing, developing, and maintaining end-to-end data pipelines.
- Hands-on AWS data engineering experience and familiarity with cloud-based data architecture.
- Experience with dashboard development, data visualization, and reporting.
Privacy & Consent:
By applying to this role, you consent to Aspirecruit processing your personal information for recruitment purposes in accordance with our Privacy Policy.
Equal Opportunity Employer:
Aspirecruit Inc. is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and do not discriminate based on race, religion, gender, age, disability, or any other protected status.
How to Apply
Please share your resume at Saumya.rawat@aspirecruit.1 total views, 1 today