Data Engineer | Core Compete

Job Title:
Data Engineer

Job Location:
Hyderabad, Pune

Job Duties and Responsibilities
Contribute in developing big data pipelines in the cloud platforms such as Google/AWS/Azure
Work on migrating on-prem data warehouses to cloud platform
Implement scalable big data processing frameworks
Perform data validation
Contribute in reusable code and accelerators development
Training and mentoring other members in the team
Work with customer and stakeholders on requirements analysis and projects execution
Follow coding principles and standards
Performance optimization of processing and managing large volume of data in cloud
Open to learn new technologies in a short duration

Required Skills and Experience
4+ years of experience of working with programming language such as Python
Cloud platform experience such as AWS, GCP and Azure
Experience of working with cloud data warehouses such as Google Big Query, Snowflake, Redshift and Azure SQL DW
Experience of working with Spark (preferably Pyspark)
Must have experience of working in data management space along with ETL/ELT experience
Good to have experience of working with SQL
Experience in Data warehouse design and implementations (on cloud)
Good to have experience with Apache Kafka, Google Pub Sub, Kinesis, AWS Lambda, DynamoDB and HBase
Strong verbal and written communications skills are a must

Education
Bachelor/master’s degree in Computer Science, Computer Engineering, or related discipline.
'
To Apply Above Job Visit: https://corecompete.com/jobs/data-engineer-python/