Deskripsi Pekerjaan
Join our dynamic team at Clicktek Consulting Inc as a Data Engineer and play a pivotal role in shaping our data infrastructure and analytics capabilities. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines that enable our organization to make data-driven decisions. You will work with cutting-edge technologies including Microsoft Fabric, Data Factory, Dataflows Gen2, and Spark to create efficient batch and streaming data solutions.
In this role, you will collaborate closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into scalable data solutions. You will ensure data quality, reliability, and accessibility while optimizing for performance and cost. If you are passionate about data engineering and thrive in a fast-paced environment, we encourage you to apply and contribute to our data-driven culture.
Tanggung Jawab
- Design, develop, and maintain batch and streaming data pipelines using Microsoft Fabric, Data Factory, Dataflows Gen2, and Spark
- Collaborate with cross-functional teams to understand data requirements and translate business needs into technical solutions
- Ensure data quality, integrity, and security across all data platforms and pipelines
- Optimize data processing workflows for performance, scalability, and cost-effectiveness
- Monitor and troubleshoot data pipeline issues to ensure smooth data flow and availability
- Develop and maintain data models, databases, and data warehouses to support analytics and reporting
- Stay current with emerging data technologies and best practices in data engineering
Kualifikasi
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field
- 3+ years of experience in data engineering, ETL/ELT processes, and data pipeline development
- Proficiency in Microsoft Fabric, Data Factory, Dataflows Gen2, and Spark
- Strong knowledge of SQL and experience with relational and NoSQL databases
- Familiarity with cloud platforms (Azure, AWS, or GCP) and data storage solutions
- Experience with data modeling, data warehousing concepts, and data governance practices
- Excellent problem-solving skills and attention to detail
- Strong communication skills and ability to work effectively in a team environment