Senior Data Engineer
Overview
We are seeking a skilled and dedicated Senior Data Engineer to join a team developing a world class data platform to support customers and products. The ideal candidate will play a crucial role in designing, building, and maintaining the data infrastructure, ensuring seamless data flow and accessibility for various stakeholders. This position offers an exciting opportunity to work with cutting-edge technologies and contribute to data-driven decision-making processes.
Requirements
- Design, develop, and maintain scalable data pipelines to support ongoing data analysis.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data availability.
- Implement and optimise ETL (Extract, Transform, Load) processes to consolidate data from various sources.
- Monitor and troubleshoot data systems to ensure high performance and reliability.
- Manage and optimise data storage solutions to improve data retrieval and processing efficiency.
- Ensure data quality and integrity by implementing best practices and performing regular data audits.
- Stay updated with the latest industry trends and technologies to continually enhance data engineering practices.
Responsibilities
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Proficiency in SQL and experience with database management systems (e.g., MySQL, PostgreSQL).
- Experience with data pipeline and workflow management tools (e.g., Apache Airflow).
- Familiarity with big data tools and frameworks (e.g., Hadoop, Spark).
- Proficient in programming languages including Python and Java, or Scala.
- Knowledge of cloud platforms (e.g., AWS, Azure, Google Cloud) and data warehousing solutions (e.g., Redshift, BigQuery).
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork abilities.
Remote
Discover Live Job Opportunities
Explore our latest job openings and find your dream career.
Unlock Your Potential with Atlantic
Discover why industry leaders and top talent trust us.