JOB DESCRIPTION
"As a Data Engineer, you can transform how a company operates; high data quality and tooling is the biggest lever to achieving that transformation. You will make that happen.
5+ years of relevant software development industry experience
Working knowledge of relational databases and query authoring (SQL, Scala, Python).
Experience with Big Data technologies (Hadoop, Hive Spark, Presto, Flink, Kafka).
Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions.
Experience in designing and deploying high performance systems with reliable monitoring and logging practices.
Experience or desire to work collaboratively in cross-functional teams with design, product, data science, and research partners.
Ability to effectively communicate with non-technical stakeholders.
Expertise in architecting and developing solutions to ambiguous problems, and integrations across multiple teams with significant impact.
Bachelor's degree or equivalent practical experience.
[Bonus] Experience with leveraging LLMs"
"Design, document, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.
Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.
Build scalable data pipelines (SparkSQL, Scala & Python) leveraging Airflow scheduler/executor framework
Collaborate with cross-functional teams, including Data Scientists, Product Managers, Operations, Finance & fellow Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.
Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity
Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues"
SQL(4), Spark(4), Python(3)
Bachelor's Degree