bigshyft
TTredence Inc.
Tredence Inc.
Senior Data Engineer
Series B
Start-up
1001-5000 employees
6y - 12y
₹20 - ₹40 LPA
Hyderabad
ETL, Snowflake, PySpark, SQL, Apache

Role

Company

Job Description

What you'll do:

  • Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space
  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues
  • Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussion with client architect and team members
  • Orchestrate the data pipelines in scheduler via Airflow

What makes you a great fit:

  • Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
  • Deep understanding of Star and Snowflake dimensional modelling.
  • Strong knowledge of Data Management principles
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
  • Should have hands-on experience in SQL, Python and Spark (PySpark)
  • Candidate must have experience in AWS/ Azure stack
  • Desirable to have ETL with batch and streaming (Kinesis).
  • Experience in building ETL / data warehouse transformation processes
  • Experience with Apache Kafka for use with streaming data / event-based data
  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
  • Experience working with structured and unstructured data including imaging & geospatial data. 
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
  • Should have experience working in Agile methodology
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail
All about us
Tredence Inc.

Tredence is a global data science solutions provider focused on solving the last mile problem in AI. The ‘last mile’ is the gap between insight creation and value realization. Headquartered in San Jose, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from their analytics investments. Tredence is a Great Place to Work-Certified and a ‘Leader’ in the Forrester Wave: Customer Analytics Services. Tredence is 1,500-plus employees strong with offices in San Jose, Foster City, Chicago, London, Toronto, and Bangalore, with the largest companies in retail, CPG, hi-tech, telecom, healthcare, travel, and industrials as clients.

Employee count
1001-5000 employees
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
San Jose, California, United States

Apply to Similar Jobs

  • PP99SOFT
    P99SOFT
    Senior Data Engineer
    51-200 employees
    Private
    6y - 8y
    ₹18 - ₹25 LPA
    Hyderabad
    Snowflake, SQL, Data Warehousing, data architect, Data Visualization
  • VVrinda Global Private Limited
    Vrinda Global Private Limited
    Data Engineer
    Unfunded
    Start-up
    201-500 employees
    4y - 9y
    ₹12 - ₹30 LPA
    Hyderabad
    SQL, ETL, Python, AWS, Linux
  • PPersistent Systems
    Persistent Systems
    Big Data Developer
    10
    001+ employees
    None
    6y - 8y
    ₹20 - ₹30 LPA
    Hyderabad, Bengaluru/ Bangalore
    Spark, SQL, ETL, Big Data, Java
  • CCognizant
    Cognizant
    Sr. Manager /Data Architect
    AI/ML
    IoT
    Marketing Tech
    B2B
    IaaS
    10y - 11y
    ₹30 - ₹35 LPA
    Hyderabad
    Python, R, Data Warehousing, SQL, ETL
  • RRisk Resources
    Risk Resources
    Senior Data Engineer for an MNC.
    HR Tech
    B2B
    Unfunded
    Start-up
    Service
    8y - 15y

    Competitive pay

    Hyderabad
    Python, Data Science, Data Modeling, Snowflake, Airflow