Data Engineer

Data Engineer

Design & Development: 

• Design and implement data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Big Query.

• Work with other DEs to integrate data solutions into existing or new applications.

• Develop and manage data integration processes to extract data from various sources, transform and cleanse it, and load it into appropriate data storage systems.

• Implement robust ETL processes to ensure data quality and consistency especially in large Datawarehouse setup.

Data Modelling and Optimization:

• Design and implement data models and schemas that meet business requirements and support efficient data retrieval and analysis.

• Optimize data structures and queries for performance and scalability.

Monitoring and Maintenance:

• Monitor data pipelines and processes for data quality issues.

• Troubleshoot and resolve data-related problems in a timely manner.

• Perform regular data backups and implement disaster recovery procedures.

Collaboration and Documentation:

• Collaborate with cross-functional teams to understand data requirements and provide technical guidance and support.

• Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.