About the company:
Our partner is at the forefront of promoting safety, sustainability, and crew well-being in the maritime sector. They are integrating innovation, digital solutions, and data-driven strategies to revolutionize the industry. Join them as a Data Engineer and contribute to their commitment to excellence and transformative growth.
Your Impact:
As a Data Engineer, you will play a pivotal role in architecting and maintaining cutting-edge data solutions that tackle the industry's challenges. Collaborate with a dedicated team of Data Engineers, champion data management, uphold dataset integrity, and strengthen their commitment to robust data governance.
Why You Should Join:
- Cutting-edge Technology: Work with the latest technologies and tools, including Unity Catalog, Azure cloud computing services, Python, SQL, Spark, and more
- Impactful Projects: Contribute to projects that have a real impact on the safety and sustainability of the maritime industry
- Collaborative Environment: Join a collaborative team where your expertise is valued, and your contributions make a significant difference
- Continuous Learning: Engage in continuous learning and development, staying ahead in the rapidly evolving field of data engineering
Your Responsibilities:
- Provide subject matter expertise in data management and governance
- Utilize Unity Catalog for centralized data governance
- Leverage streaming technologies for real-time data processes
- Implement and manage delta live tables for data integrity and version control
- Work with Azure cloud computing services, particularly Azure SQL and Databricks
- Contribute to automated data quality validation solutions
- Participate in technical discussions and onboarding of data partners/vendors
- Provide inputs to BI and Data Science teams for developing new products and reports
Requirements
- Bachelor's or Master's degree in Computer Science, Software Engineering, AI, or equivalent
- 3+ years of proven experience as a Data Engineer
- Proficiency in Python, SQL, and Spark (PySpark)
- Strong foundation in solid software engineering principles
- Experience with CI/CD platforms such as Azure DevOps
- Familiarity with the Lakehouse model and Delta protocol
- Experience with Azure Stack, notably Databricks (certifications are a plus)
- Expertise in dimensional modeling, star schemas, and classic data warehousing practices
- Comfortable with batch and streaming workloads, preferably using Spark Structured Streaming
- Knowledge of Delta Live Tables ETL framework and its role in implementing medallion architectures
- Experience with maritime datasets is highly preferable
Benefits
- Salary: upto 75.000.000 VND/ month
- Allowance: 2.000.000 VND monthly
- Full equipment including laptop
- Health Care Insurance
