Work with stakeholders to understand needs for data structure, availability, scalability, and accessibility.
▪ Develop tools to improve data flows between internal/external systems and the data lake/warehouse.
▪ Build robust and reproducible data ingest pipelines to collect, clean, harmonize, merge, and consolidate data sources.
▪ Understanding existing data applications and infrastructure architecture
▪ Build and support new data feeds for various Data Management layers and Data Lakes ▪ Evaluate business needs and requirements
▪ Support migration of existing data transformation jobs in Oracle, and MS-SQL to Snowflake.
▪ Lead the migration of the existing data transformation jobs in Oracle, Hive, Impala etc. into Spark, Python on Glue etc.
▪ Able to document the processes and steps.
▪ Develop and maintain datasets.
▪ Improve data quality and efficiency.
▪ Lead Business requirements and deliver accordingly.
▪ Collaborate with Data Scientists, Architect and Team on several Data Analytics projects. ▪ Collaborate with DevOps Engineer to improve system deployment and monitoring process.
Soft Skills
▪ Ability to work in a collaborative environment and coach other team members on coding practices, design principles, and implementation patterns that lead to high quality maintainable solutions.
▪ Ability to work in a dynamic, agile environment within a geographically distributed team.
▪ Ability to focus on promptly addressing customer needs.
▪ Ability to work within a diverse and inclusive team.
▪ Technically curious, self-motivated, versatile and solution oriented.