Data Engineer Team Lead
As the Data Engineer Team Lead, you will play a crucial role in overseeing the design, development, and optimization of our data pipelines, ensuring seamless integration and availability of data across all systems. You will lead a talented team of data engineers and spearhead the execution of data strategies that are integral to supporting critical business decisions and operations. A significant responsibility is to develop a unified data pipeline that effectively serves both internal systems and external applications, ensuring secure and real-time data flow across all platforms.
Apply now
Apply Now
Job Description:
- Team Leadership: Lead and mentor a team of data engineers to design, build, and optimize scalable data pipelines for analytics, reporting, and operational needs.
- Unified Data Pipeline Management: Create and manage a unified data pipeline that integrates multiple data sources, facilitating efficient access for both internal and external systems, including third-party tools and client-facing platforms.
- Utilization of Low-Code/No-Code Tools: Leverage low-code/no-code integration tools such as Fivetran or RudderStack to accelerate data workflows and improve integration efficiency.
- Data Governance and Quality Assurance: Implement and manage data governance and quality standards, ensuring data consistency and reliability throughout the organization.
- Real-Time and Batch Data Architecture: Architect and oversee the implementation of real-time and batch data pipelines using data streaming tools like Kafka or Pub/Sub, ensuring low-latency, high-performance data processing.
Job Requirements:
- Education: Bachelor’s degree in Computer Science, Data Engineering, or a related field.
- Experience: 10+ years in data engineering, with at least 3+ years in a management or leadership role.
- Expertise in designing, building, and maintaining data pipelines and data warehouses.
- Strong knowledge of cloud platforms (Google Cloud or AWS) and familiarity with tools like BigQuery, PostgreSQL, and Airflow.
- Proficient in programming languages such as Python, with experience in ETL/ELT processes.
- Hands-on experience with low-code/no-code data integration tools.
- Deep understanding of real-time data processing and streaming technologies such as Kafka or Pub/Sub.
- Understanding of Data Frameworks: Experience in building unified data pipelines for secure and consistent data flows, working with both real-time and batch processing systems.
Interested applicants please email to ravi.varman@tg-hr.com for immediate action.
- Tenure: Permanent
- Offered Salary: RM15,000 – RM20,000 (Salary will commensurate based on relevant experience)
- Location: Selangor
- Industry: Financial Technology