bigshyft
EExpand My Business
Expand My Business
Data Engineer
Unfunded
Start-up
201-500 employees
4y - 6y
₹12 - ₹27.5 LPA
Bengaluru/ Bangalore
ETL, Python, AWS, Data Warehousing, Spark

Role

Company

Job Description

What makes you a great fit:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer with expertise in ETL techniques (2+ years) is a MUST
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Skillset to scrape and transform data off of the publicly available web sources
  • Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
  • Proficiency in SQL and experience working with relational and non-relational databases.
  • Knowledge of data warehousing concepts and architectures.
  • Familiarity with big data technologies such as Hadoop, Spark, and Kafka.
  • Experience with data modeling tools and techniques.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Master's degree or equivalent in Computer Science/ Data Science
  • Knowledge of data streaming and real-time processing.
  • Familiarity with data governance and security best practices.
  • ETL Development: Design, develop, and maintain efficient ETL processes for multi-scale data sets.
  •  Implement and optimize data transformation and validation processes to ensure data accuracy and consistency.                                          
  • Data Pipeline Architecture: Architect, build and maintain scalable and high-performance data pipelines
  •  Evaluate and implement new technologies to enhance data pipeline efficiency and reliabili
  •  Pipelines for extracting data through scraping for ad-hoc sector specific datasets
  • Data Modelling: Develop and implement data models to support analytics and reporting needs.
  • Optimize database structures for performance and scalability.
  • Data Quality and Governance: Implement data quality checks and governance processes to ensure data integrity.
  • Collaborate with stakeholders to define and enforce data quality standards.
  • Documentation and Communication Document ETL processes, data models, and other relevant information.  
  •  Communicate complex technical concepts to non-technical stakeholders effectively.
  • Cross-functional collaboration: Collaborate internally with the Quant team and developers to lay and optimize the data pipelines and externally with the stakeholders to understand the business requirements for the enrichment of the cloud database
All about us
Expand My Business

We’re on a mission to simplify digital transformation for businesses of all sizes. Whether you're a founder taking your business online or a corporate leader seeking exemplary IT and marketing solutions, you don’t have to look further than our 360-degree digital offerings. Our 3 major verticals include: IT Development, Digital Marketing, and Web 3.0. Benefits you get: 1. One-stop solution for all your digital needs 2. A pool of 1500+ verified development and marketing agencies 3. Continued support through expert consultancy and project management 4. Secure payments through our milestone-based payment structure Up till now, we've delivered over 3000 projects with success, including notable clients such as Tata Digital, India Today, Walmart, Dabur, Flipkart and Swiggy Instamart. Our enthusiastic team brings together expertise, creativity, and a deep understanding of market trends to drive tangible results for our clients.

Employee count
201-500 employees
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
Gurugram, Haryana, India

Apply to Similar Jobs

  • KKratos Gaming Network
    Kratos Gaming Network
    Data Engineer
    51-200 employees
    Private
    3y - 6y
    ₹20 - ₹35 LPA
    Bengaluru/ Bangalore
    AWS, SQL, ETL, Python, PySpark
  • BBlazeClan Technologies
    BlazeClan Technologies
    Sr AWS Data Engineer
    Seed
    Start-up
    501-1000 employees
    4y - 5y
    ₹12 - ₹20 LPA
    Pune, Bengaluru/ Bangalore, Mumbai
    PySpark, Spark, Python, AWS, Data Warehousing
  • NNIRA
    NIRA
    Senior Data Engineer
    Series A
    Start-up
    201-500 employees
    3y - 5y
    ₹10 - ₹30 LPA
    Bengaluru/ Bangalore
    Hadoop, Spark, AWS, Python, Kafka
  • DDigit88
    Digit88
    Data Engineer
    Unfunded
    Start-up
    51-200 employees
    4y - 7y
    ₹25 - ₹45 LPA
    Remote/ Work from Home, Bengaluru/ Bangalore, Pune
    Scala, Kafka, Spark, AWS, SQL
  • AAutonomize AI
    Autonomize AI
    Senior Data Engineer
    Seed
    Start-up
    11-50 employees
    5y - 7y

    Competitive pay

    Bengaluru/ Bangalore
    Data Warehousing, Python, CI/CD, AWS, Azure