S
Sequoia
Senior Data Engineer
Unfunded
Start-up
501-1000 employees
8y - 11y
₹30 - ₹50 LPA
Bengaluru/ Bangalore
Python, Spark, Kafka, AWS, Data Pipeline
Role
Company
Job Description
What you'll do:
- Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks.
- Deploy and provide support for application codes and analytical models.
- Provide senior-level technical consulting to peer data engineers during design and development for highly complex and critical data projects.
- Create and enhance data enabling seamless integration and flow across the data ecosystem.
- Provide business analysis and develop ETL code and scripting to meet all technical specifications and business requirements according to the established designs.
- Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Python and AWS-based solutions.
- Utilize multiple development languages/tools such as Python, SPARK, Hive to build prototypes and evaluate results for effectiveness and feasibility.
- Contribute to determining programming approach, tools, and techniques that best meet the business requirements.
- Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes.
- Operationalize open source data-analytic tools for enterprise use.
- Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.
What makes you a great fit:
- 8+ years of experience in data platform administration/engineering
- Capability to architect highly scalable distributed systems, using different tools
- Expert knowledge of data modelling and understanding of different data structures and their benefits and limitations under particular use cases
- Experience using Big Data batch and streaming tools.
- Knowledge and experience using query languages (SQL, Cypher) for relational and graph databases
- Capability to collaborate with stakeholders and project leaders to understand requirements, deliverables, and set expectations on tasks that you will be responsible for
- Ability to work in a fast-paced, rapidly changing environment
- Experience working in an agile and collaborative team environment
- Excellent written and verbal communication, presentation and professional speaking skills
- Passion for learning and interest in pursuing classroom training and self-discovery on a variety of emerging technologies
- Hands-on experience with Amazon Web Services (AWS)-based solutions such as Lambda, Dynamodb, Snowflake and S3
- Experience in migrating ETL processes (not just data) from relational warehouse databases to AWS-based solutions
- Experience within the financial industry
- Strong documentation, customer service and communication skills
- Innovative and able to reach and collaborate with other team members and functional teams
- Ability to handle multiple tasks in a fast-paced environment
- Most importantly, live our Sequoia values day in and day out
All about us
Sequoia
Sequoia is the pioneer in total people investment. We help companies master the practice of driving outcomes that matter through their total rewards. With expert guidance and the Sequoia People Platform, we connect our offerings for compensation, benefits, wellbeing, HR and payroll, and business protection to a higher strategic outcome, enabling companies to manage their global people investments, reduce administrative burdens, and reach a deeper level of employee care and support.
Employee count
501-1000 employees
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
San Mateo, California, United States
Our links
http://sequoia.comFind Popular Jobs on BigShyft.com
Jobs By Skill in City
Apply to Similar Jobs
- LLight & WonderData EngineerPublic1001-5000 employees7y - 12y
Competitive pay
Bengaluru/ BangaloreSpark, RDMS, AWS, Snowflake, Python - LLifesightSenior Data EngineerSeedStart-up51-200 employees5y - 10y₹20 - ₹45 LPABengaluru/ BangaloreJava, Python, MySQL, Spark, Google Cloud Platform
- EEagleViewStaff Engineer - Data pipelineAcquiredStart-up1001-5000 employees10y - 15y
Competitive pay
Bengaluru/ BangaloreSpark, Kafka, AWS, Scala, Golang - FFalconXData EngineerSeries DStart-up51-200 employees5y - 10y₹20 - ₹50 LPABengaluru/ BangaloreDatalake, Spark, PySpark, Python, SQL
- AAdvisor360Senior Data EngineerUnfundedStart-up501-1000 employees7y - 11y₹35 - ₹65 LPABengaluru/ BangalorePython, Databricks, Snowflake, Kubernetes, Azure
Find Popular Jobs on BigShyft.com
Jobs By Skill in City
- Home
- >
- Jobs in Bengaluru
- >
- Python Jobs
- >
- Python Jobs in Bengaluru
- >
- Senior Data Engineer