BFL Group
BFL Group is currently looking to hire a candidate for the job role of a Data Engineer in TechnoPark, Dubai, UAE. This is a Senior level full time job. And salary can range between 15000-35000 AED/month. Desirous applicants to hurriedly apply and make use of this fleeting opportunity.
Responsibilities
- Architect, design, and implement end-to-end data pipelines within Google Big Query to support data ingestion, transformation, and analysis.
- Utilize Google Cloud Data Fusion (CDF) to orchestrate data ingestion and extraction processes from various sources into Google Big Query.
- Integrate diverse data sources including on-premises SQL Server, Oracle MFCS (SaaS), SaaS applications for Loyalty and CDP platforms, modern POS and WMS systems, and E-Commerce data from MERN stack applications.
- Collaborate closely with cross-functional teams to understand data requirements and translate them into scalable solutions within Big Query.
- Ensure data quality, consistency, and integrity by implementing effective validation and cleansing processes within Big Query.
- Optimize Big Query performance and resource utilization to meet scalability, throughput, and cost-efficiency goals.
- Implement and manage ETL processes for loading and transforming data into Big Query using Apache Beam/Dataflow or similar frameworks.
- Develop and enforce data governance policies and security measures within Big Query to maintain compliance standards.
- Provide technical guidance and support for troubleshooting and resolving data-related issues within Big Query.
Requirements for Role of Data Engineer
- Bachelor’s degree in computer science, Engineering, or a related field; master’s degree preferred.
- 8+ years of experience in designing and implementing data warehouse and data lake solutions.
- Proven experience as a Data Engineer with a focus on Google Big Query, including hands-on experience in designing and building data pipelines.
- Expertise in SQL with proficiency in querying and optimizing performance within Big Query.
- Experience with ETL tools and frameworks such as Apache Beam, Dataflow, or similar for managing data workflows in Big Query.