О компании
We are developing an IT product that includes a large-scale WEB platform and an interactive Telegram bot / Mini App.
Обязанности
- Develop and maintain ETL/ELT processes based on Airflow and dbt Core
- Integrate new data sources: PostgreSQL, external APIs, and services
- Develop existing data warehouse on ClickHouse and support analytical dashboards
- Optimize SQL queries and pipeline performance
- Support and develop the analytical platform infrastructure (Docker, Airflow, dbt)
- Collaborate with analysts to implement new dashboards, metrics, and data sources
- Participate in investigating incidents related to data quality and pipeline performance
- Maintain technical documentation and participate in knowledge transfer within the team
Требования
- Experience as a data engineer for at least three years
- Strong knowledge of SQL and experience with analytical DBMS
- Practical experience with ClickHouse: table design, engine selection, partitioning, query optimization
- Experience in developing and maintaining ETL/ELT processes: ability to independently choose the method of data source integration, design loading structure, storage, and data updates considering business requirements and technical constraints
- Experience with Apache Airflow 2+: developing, supporting, and debugging DAGs, understanding scheduling mechanisms, dependencies, and pipeline monitoring
- Experience with dbt Core
- Good knowledge of Python: ability to understand existing code, modify and develop new components of integrations and pipelines
- Experience with PostgreSQL and understanding of incremental data export features
- Experience integrating external REST APIs
- Understanding of containerization principles and experience with Docker / Docker Compose
- Ability to independently decompose tasks and drive them to completion
Условия и бенефиты
- Remote work format
- Time zone: MSK
Как откликнуться
Please send your resume to https://t.me/katyacheresh
