bigshyft
SSolytics Partners
Solytics Partners
Senior Data Engineer
Unfunded
Start-up
201-500 employees
6y - 9y
₹18 - ₹27.5 LPA
Pune
Artificial Intelligence (AI), Machine Learning (ML), Python, Apache, ETL

Role

Company

Job Description

What you'll do:

  • Design, develop, and maintain scalable data pipelines that support the ingestion and processing of large datasets for AI/ML applications.
  • Collaborate with data scientists and business stakeholders to identify and define AI/ML use cases that drive value.
  • Clean, preprocess, and transform raw data into structured formats suitable for analysis and machine learning tasks.
  • Work closely with data scientists to ensure data is optimized for AI/ML use cases.
  • Ensure data quality, integrity, and availability for AI/ML initiatives.
  • Conduct exploratory data analysis to inform model development and feature engineering.
  • Optimize machine learning models for performance and scalability, utilizing best practices in model evaluation and selection.
  • Monitor data pipelines and AI/ML processes to ensure reliability and performance.
  • Troubleshoot and resolve data-related issues, ensuring data integrity throughout the pipeline.

What makes you a great fit:

  • 6+ years of experience as a Data Engineer, with a strong focus on AI/ML applications.
  • Proficiency in Python for data manipulation and processing.
  • Experience with data pipeline tools (e., Apache Airflow, Luigi, or similar).
  • Solid understanding of data architecture, data modelling, and ETL processes.
  • Familiarity with cloud platforms (e., AWS, Azure, GCP) and containerization technologies (e. , Docker, Kubernetes) is a plus.
  • Experience in the banking or fintech industry is highly desirable.
  • Knowledge of SQL and NoSQL databases for data querying and management.
  • Familiarity with machine learning frameworks (e., TensorFlow, PyTorch) is a plus, but not required
All about us
Solytics Partners

We are a global analytics firm focused on solving client problems through an amalgamation of advanced analytics, new-age technologies, and deep domain expertise. Our cross-functional team of risk and AML experts, AI/ML data scientists, data engineers, business analysts, etc have experience working with major financial institutions (banks, asset managers, insurance firms, hedge funds, weath managers, credit unions, and non banking financial corporations) in the areas of Risk Management, AML Compliance, and Data Analytics. With operations based out of Argentina, India, UAE, the UK, and the US, we strive to serve our customers with a global perspective through our "accelerated services" consulting approach, bespoke automation and standardization deliverables, and our compelling business solutions for AML processes and the model risk management lifecycle.

Employee count
201-500 employees
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
New York City, New York, United States

Apply to Similar Jobs

  • UUST
    UST
    Big Data Engineer
    Public
    10
    001+ employees
    6y - 8y
    ₹18 - ₹27.5 LPA
    Bengaluru/ Bangalore, Pune, Delhi
    Big Data, Hadoop, Spark, Python, Scala
  • TTalent join
    Talent join
    AWS Data Engineer
    Unfunded
    Start-up
    1-10 employees
    7y - 8y

    Competitive pay

    Bengaluru/ Bangalore, Pune, Chennai
    AWS, Python, SQL, NoSQL
  • DDigit88
    Digit88
    Data Engineer
    Unfunded
    Start-up
    51-200 employees
    4y - 7y
    ₹25 - ₹45 LPA
    Remote/ Work from Home, Bengaluru/ Bangalore, Pune
    Scala, Kafka, Spark, AWS, SQL
  • SSearce
    Searce
    Lead Data Engineer
    Unfunded
    Start-up
    4y - 10y

    Competitive pay

    Pune, Mumbai
    Big Data, Python, SQL, GIT, BigQuery
  • DDigit88
    Digit88
    Senior Bigdata Engineer
    Unfunded
    Start-up
    51-200 employees
    6y - 10y
    ₹20 - ₹40 LPA
    Pune
    Java, Python, Spark, AWS, Scala