As a Data Engineer, you'll lead initiatives optimizing data flow, ensuring quality, and implementing security measures.
Job Description:
Data Engineering
- Design and implement scalable and secure data pipelines for collecting, processing, and storing data.
- Develop and maintain datasets, ensuring accuracy, completeness, and compliance with security standards.
- Work closely with data scientists and analysts to understand data needs and implement solutions that meet compliance requirements.
- Implement robust data quality checks and validation processes to identify and rectify inconsistencies, ensuring data integrity.
- Optimize data processing and storage for efficiency, cost-effectiveness, and compliance.
- Identify and implement solutions to enhance the performance of data pipelines, with a focus on security best practices.
- Apply expertise in security practices, ensuring the protection of sensitive data.
Job Requirements:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 2 or more years of experience as a Data Engineer, ETL Developer, or similar roles, with expertise in ETL processes and tools.
- Experience in data modeling, data lake, and data warehousing
- Strong proficiency in programming languages such as Python, Java, or Scala.
- Strong proficiency in Airflow for designing and managing complex workflows and dependencies.
- Solid understanding of data analytics and flow analysis for mobile app user interfaces.
- Familiarity with database systems (e.g., SQL, NoSQL) and data integration tools.
- Strong analytical and problem-solving skills with a detail-oriented mindset.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
- Knowledge of cloud platforms (e.g., AWS, GCP) and related data technologies is a plus.
- Knowledge of security practices in the context of data handling.
- Familiarity with version control systems (e.g., Git) and agile software development practices.
- Good communication skills & ability to explain your findings to business/technical stakeholders in an efficient manner.
- Be able to manage time effectively & deliver high-quality work.
- Ability to work independently and manage multiple tasks within deadlines.
- Possess a proactive mindset & positive attitude, able to bring in good influences to your teammates & stakeholders.
