P
PureSoftware
Data Engineer
Unfunded
Start-up
7y - 15y
₹20 - ₹45 LPA
Bengaluru/ Bangalore
Python, SQL, CI/CD, ETL, Pandas
Role
Company
Job Description
What you'll do:
- Identifying, designing, and implementing scalable data delivery pipelines and automating manual processes. Data cleaning and transformation/manipulation of raw data.
- ETL process design, implementation, maintenance, and documentation for large inter-connected data sets. Create and maintain detailed documentation of workflows.
- Productionize and scale the already written python/pandas code.
- Employ creative techniques for data wrangling tasks, joining multiple datasets together, data exploration to create unique products while working with domain experts.
- Building required infrastructure for optimal data extraction, transformation and loading of data using cloud technologies like AWS.
- Utilize existing database infrastructures and building new DB infrastructures as required.
- Use of data development software (ETL packages) and programming languages and tools (usually SQL and Python) to develop tools to extract, transform and load data, as well as to document the creation of these tools.
- Identifying, assembling, and enriching a wide range of structured and unstructured data to support new financial data sets and analysis.
What makes you a great fit:
- 7+ years of experience in data manipulation/engineer role with an engineering background.
- Strong understanding of data, including how to interpret it, perform Exploratory Data Analysis (EDA) if required, and extract meaningful insights from it. Highlight data issues and inconsistencies, if any.
- Expertise in Python and data manipulation libraries like Pandas, NumPy is a must.
- Ability to refactor, optimize and productionize the already written POC code.
- Proven experience with SQL databases like Oracle DB/SQL Server/MySQL/Snowflake.
- Proven experience with AWS (Glue, Athena, EC2, S3, Lambda, RDS)
- Working knowledge of Iceberg / delta lake tables
- Experience working with CI/CD, Infrastructure-as-Code, and other automation tools.
- Familiarity with DevOps tool
- Familiar with techniques to manage large datasets, including partitioning, indexes as well as data mining.
- Excellent communication skills as you will need to discuss technical principles and business processes in simple language to people at all levels.
- Be able to build relationships with global colleagues working remotely.
- Enthusiasm for learning, trying new things, sharing knowledge, and developing skills in others.
- Being independent and proactive to find information and raise questions.
- Data acquisition skills would be advantageous.
All about us
PureSoftware
PureSoftware, a wholly owned subsidiary of Happiest Minds, is a global software products and digital services company. PureSoftware has been driving transformation for the world’s top organizations across various industry verticals, including banking, financial services, and insurance, life sciences and healthcare, high tech and communications, retail and logistics, and gaming and entertainment. Arttha, from PureSoftware, is a globally trusted financial technology platform.
Employment Type
Full Time Job
Company Type
Start-up
Headquarters
Noida, Uttar Pradesh, India
Our links
http://www.puresoftware.comFind Popular Jobs on BigShyft.com
Jobs By Skill in City
Apply to Similar Jobs
- EEmidsSr. Data Engineer1001-5000 employeesNone7y - 10y₹20 - ₹32.5 LPABengaluru/ BangaloreAzure, ETL, Python, Databricks, SQL
- AAventus PartnersData EngineerHR TechB2BUnfundedStart-upService6y - 8y₹25 - ₹55 LPABengaluru/ BangaloreJava, Python, Scala, SQL, Data Warehousing
- FFalconXData EngineerSeries DStart-up51-200 employees5y - 10y₹20 - ₹50 LPABengaluru/ BangaloreDatalake, Spark, PySpark, Python, SQL
- TTalent joinAWS Data EngineerUnfundedStart-up1-10 employees7y - 8y
Competitive pay
Bengaluru/ Bangalore, Pune, ChennaiAWS, Python, SQL, NoSQL - MMacroHireTech Lead - Azure Data EngineerUnfundedStart-up51-200 employees7y - 9y₹20 - ₹27.5 LPABengaluru/ BangaloreAzure, Databricks, SQL, ETL, Power BI
Find Popular Jobs on BigShyft.com
Jobs By Skill in City
- Home
- >
- Jobs in Bengaluru
- >
- Python Jobs
- >
- Python Jobs in Bengaluru
- >
- Data Engineer