Databricks Engineer

Job Title: Databrick

Company Intro:

Binmile is a global fast-growing outsourced IT services company, with a culture that is passionate about innovation and automation. Our mission is to create an extraordinary impact on the world through our culture and digital technology excellence. Binmile combines agility and speed of implementation to tailor innovative future-focused solutions in Software Product Engineering; all fueled by AI and automation.
 

Role:

· Deep development background that must include years of experience in Spark with Scala/Python
· Design and implement performant data ingestion dataflows from multiple sources using Azure Databricks.
· Assist with and execute programming, modelling, and data integration, supporting task automation and DevOps practices.
· Unit test to ensure the required performance through large-scale testing.
· To provide job mentoring

Skills:

· PySpark/Scala programming language and development on Azure Databricks using PySpark/Scala.
· End-to-end pipeline development on Azure Data Factory.
· Code versioning tools such as Git
· Must have worked with Continuous Integration and deployment tools (CI/CD)
· Knowledge of Azure services such as Azure Storage, Azure Data Lake, Azure SQL Data Warehouse, NoSQL DB like MongoDB or Cosmos, Azure event hubs
· Jenkins builds and releases pipelines (Good to have)
· Data Warehouse, Data Lake, Business Intelligence concepts
· Intermediate SQL expertise.
· Strong understanding of troubleshooting issues.

 

Top benefits and perks:

As a Binmillion, you’ll enjoy:

Opportunity to work with the Leadership team.
Health Insurance
Flexible working structure
Binmile is an Equal Employment Opportunity Employer. We celebrate diversity and are committed to building a team that represents various backgrounds, perspectives, and skills.