Responsibilities:

  • Develop, implement, and maintain efficient and scalable data engineering solutions to support the company's data initiatives.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical data engineering solutions.
  • Build and maintain data pipelines to ingest, transform, and store data from various sources, ensuring data quality, integrity, and reliability.
  • Deploy and operationalize machine learning models for real-time inference and prediction on edge devices.
  • Optimize data processing workflows to achieve high performance and low latency in handling large volumes of data.
  • Design and implement data warehouse and data lake solutions to support data analytics and reporting needs.
  • Collaborate with data scientists and data analysts to understand their data requirements and assist in the design and implementation of data solutions.
  • Monitor and troubleshoot data pipelines, proactively addressing any performance issues, bottlenecks, or failures to ensure uninterrupted data flow.
  • Stay updated with industry trends and emerging technologies in data engineering, edge computing, cloud services, data warehousing, and data lakes, and evaluate their potential for improving existing systems and processes.
  • Continuously improve data engineering processes and systems through the adoption of best practices and innovative approaches.
  • Leading a team of Data Engineers, grooming

Skills and Qualifications:

  • Understanding of data governance policies, data security measures, and relevant regulatory requirements.
  • Strong problem-solving skills and the ability to optimize data processing workflows for performance and scalability.
  • Excellent communication, collaboration, and attention to detail to deliver high-quality, reliable data solutions.
 

 

RPG Group