Role
Company
What you'll do:
- Design, develop, and maintain scalable data pipelines that support the ingestion and processing of large datasets for AI/ML applications.
- Collaborate with data scientists and business stakeholders to identify and define AI/ML use cases that drive value.
- Clean, preprocess, and transform raw data into structured formats suitable for analysis and machine learning tasks.
- Work closely with data scientists to ensure data is optimized for AI/ML use cases.
- Ensure data quality, integrity, and availability for AI/ML initiatives.
- Conduct exploratory data analysis to inform model development and feature engineering.
- Optimize machine learning models for performance and scalability, utilizing best practices in model evaluation and selection.
- Monitor data pipelines and AI/ML processes to ensure reliability and performance.
- Troubleshoot and resolve data-related issues, ensuring data integrity throughout the pipeline.
What makes you a great fit:
- 6+ years of experience as a Data Engineer, with a strong focus on AI/ML applications.
- Proficiency in Python for data manipulation and processing.
- Experience with data pipeline tools (e., Apache Airflow, Luigi, or similar).
- Solid understanding of data architecture, data modelling, and ETL processes.
- Familiarity with cloud platforms (e., AWS, Azure, GCP) and containerization technologies (e. , Docker, Kubernetes) is a plus.
- Experience in the banking or fintech industry is highly desirable.
- Knowledge of SQL and NoSQL databases for data querying and management.
- Familiarity with machine learning frameworks (e., TensorFlow, PyTorch) is a plus, but not required
We are a global analytics firm focused on solving client problems through an amalgamation of advanced analytics, new-age technologies, and deep domain expertise. Our cross-functional team of risk and AML experts, AI/ML data scientists, data engineers, business analysts, etc have experience working with major financial institutions (banks, asset managers, insurance firms, hedge funds, weath managers, credit unions, and non banking financial corporations) in the areas of Risk Management, AML Compliance, and Data Analytics. With operations based out of Argentina, India, UAE, the UK, and the US, we strive to serve our customers with a global perspective through our "accelerated services" consulting approach, bespoke automation and standardization deliverables, and our compelling business solutions for AML processes and the model risk management lifecycle.
Find Popular Jobs on BigShyft.com
Jobs By Skill in City
Apply to Similar Jobs
- SScalexSenior Data Engineer (MS Fabric)51-200 employeesPrivate5y - 7y₹15 - ₹22.5 LPAPune, HyderabadPython, ETL, Datalake, PySpark, Azure
- CCarnera TechnologiesData EngineerUnfundedStart-up51-200 employees4y - 7y₹12 - ₹20 LPARemote/ Work from Home, PunePython, MySQL, AWS, Matillion
- UUSTBig Data EngineerPublic10001+ employees6y - 8y₹18 - ₹27.5 LPABengaluru/ Bangalore, Pune, DelhiBig Data, Hadoop, Spark, Python, Scala
- TTalent joinAWS Data EngineerUnfundedStart-up1-10 employees7y - 8y
Competitive pay
Bengaluru/ Bangalore, Pune, ChennaiAWS, Python, SQL, NoSQL - DDigit88Data EngineerUnfundedStart-up51-200 employees4y - 7y₹25 - ₹45 LPARemote/ Work from Home, Bengaluru/ Bangalore, PuneScala, Kafka, Spark, AWS, SQL
Find Popular Jobs on BigShyft.com
Jobs By Skill in City
- Home
- >
- Jobs in Pune
- >
- Python Jobs
- >
- Python Jobs in Pune
- >
- Senior Data Engineer