Data Operation Engineer

About the job

We are seeking a highly motivated and skilled Data Platform Governance and Operations Specialist to join our expanding team. As a member of Governance and Operations Specialist, you will play a vital role in ensuring the smooth governance and operations of our data analytics division. You will work closely with cross-functional teams to monitor operations, maintain security controls, investigate issues, and coordinate infrastructure requirements.

Responsibilities:

1. Operation Management:

Monitor system performance, data availability, and data quality.

Manage data pipelines, ensuring efficient and reliable data flow using technologies like Fivetran and Azure Databricks.

Proactively identify and address operational issues to minimize downtime and optimize performance.

Handle support requests related to data analytics operations, utilizing ticketing systems (Service Now) to track and resolve issues.

Conduct root cause analysis and troubleshoot data-related issues, using technical knowledge of Microsoft Azure Services, Databricks, Oracle, Microsoft SQL, or other relevant platforms.

Implement solutions to resolve issues promptly and effectively, collaborating with internal teams and stakeholders.

2. Security Controls & Configurations:

Implement and maintain security controls within the data analytics division, leveraging tools and services provided by Microsoft Azure.

Manage access controls, data privacy, and security policies using tools like Microsoft Azure Active Directory or similar identity and access management solutions.

Handle audit-related requests and questions, ensuring compliance with relevant regulations and audit standards.

Creating and maintaining Databricks Workspaces for business and IS usage.

Collaborate with Information System (IS) infrastructure team to manage the required for data analytics operations, including cloud services provided by Microsoft Azure, GitHub etc.

Coordinate data storage, cloud services, and server configurations, leveraging technologies like Microsoft Azure.

Ensure the infrastructure supports the division's needs and aligns with security requirements.

Requirements:

Bachelor's degree in a relevant field (e.g., Computer Science, Data Analytics, Information Systems).

Proven experience in data analytics operations, including monitoring, troubleshooting, and infrastructure coordination.

Strong technical knowledge and hands-on experience with Microsoft Azure Services (E.g. Access provisioning using Microsoft Entra ID, creating resource groups, storage accounts, managing Cost Analytics Reports etc.).

Familiarity with Databricks (Unity Catalog) or similar big data processing and analytics platforms.

Excellent problem-solving skills and ability to investigate and resolve issues efficiently.

Team player, strong communication and collaboration skills to work effectively with cross-functional teams.

Proactive mindset with the ability to prioritize tasks and meet deadlines.

Must Have:

Microsoft Azure Platform Services (Or similar cloud platform)

Databricks Knowledge

Nice to have:

Experience in Hitachi JP1 scheduling system

Experience with ingestion tool like Fivetran (or similar tool like ADF)

Experience with version control repositories like GitHub

Experience with database technologies such as Oracle, Microsoft SQL, or other relational databases.