Senior Data Engineer

Responsibilities
● Develop and maintain data pipelines for collecting, processing, and analyzing marketing data
from various sources, including paid media platforms, CDP platforms, and marketing
automation platforms.
● Process and analyze large volumes of structured and unstructured data using PySpark.
● Utilize Google Cloud Platform services for efficient storage, processing, and analysis of
marketing data.
● Build and maintain data pipelines using Airflow DAGs to automate and schedule complex
workflows.
● Ability to write code that consumes data via real-time APIs from various marketing platforms
and integrate it into a centralized data warehouse like BigQuery.
● Ensure compliance with data privacy regulations and company policies regarding data
handling and security.
● Continuously optimize and improve existing data pipeline architectures to maximize efficiency
and performance.

Qualifications
● Minimum 4+ years experience within data engineering and/or analytics engineering team
● Proven experience in designing and implementing ETL processes for data ingestion and
integration.
● Strong proficiency in Python programming language for data processing and manipulation.
● Hands-on experience with PySpark for large-scale data processing.
● Expertise in Google Cloud Platform services, including but not limited to Google BigQuery,
Google Storage, and Google Compute Engine.
● Familiarity with Airflow for building and managing complex workflows.
● Understanding of data warehousing principles and experience with data warehouse platforms
like Snowflake, Amazon Redshift, or Google BigQuery.
● Ability to communicate effectively with both technical and non-technical audiences.
● Strong problem-solving skills and the ability to think critically about complex issues related to
data engineering and marketing data integration.
● Able to work Monday to Friday, 08-00 - 17.00 (Work from client’s office at Sunter Jakarta)

Mandatory Skills
● Google Cloud Platform
● Kubernetes
● Containerization
● Python3
● Apache Airflow
● Apache Spark
● Networking