Databricks Engineer

Are you a passionate Databricks Engineer who loves working with data and AI? Do you enjoy building cloud-based solutions that can handle massive amounts of data and deliver insights in real time? Do you have a knack for designing and implementing architectures that are scalable, reliable, and secure?

If you answered yes to these questions, then you might be the perfect fit for our team! We are Serverless Solutions, a leading provider of cloud-based solutions for data streaming and analysis. We work extensively with Databricks, along with other tools and platforms such as Azure, Google Cloud, Apache Kafka, Apache Beam, C#, Python, and SQL Server.

We are looking for a talented and experienced Databricks Engineer to join our team and help us create awesome solutions for our clients. You will work with other architects, developers, and business stakeholders to deliver high-quality solutions that meet their needs and expectations. The ideal candidate will have a strong background in Data Engineering, Analytics and Cloud Technologies; with hands-on experience in Azure Databricks, Power BI and SQL.

You will also mentor and coach more junior team members and share your knowledge and best practices. You will be a key player in our team and help us shape our culture and vision.

Responsibilities

As an Azure Databricks Engineer you will:

• Create technical designs and architectural solutions for modern data warehouse and AI projects, with a strong focus on Databricks.
• Design, develop, and maintain data pipelines using Azure Databricks.
• Optimize ETL/ELT processes to ensure performance, scalability, and reliability.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and implement effective solutions.
• Define and communicate requirements for IT and business stakeholders.
• Collaborate with other architects and developers to ensure alignment and integration of solutions.
• Mentor and help more junior team members to grow their skills and capabilities.
• Ensure data quality, security, and governance best practices.
• Work with Cloud Platforms (Azure & GCP) to deploy and manage data solutions.
• Ensure quality and performance of solutions through testing and optimization.
• Implement and maintain CI/CD pipelines for data workflows.
• Troubleshoot and resolve data-related issues, ensuring optimal system performance.

Required Qualifications:

• 5+ years of experience in data engineering, with at least 2 years working with Azure Databricks.
• Strong proficiency in Apache Spark, SQL Server, Azure Databricks, SQL, Python, and Power BI.
• Strong knowledge of best practice patterns and architectures for modern data warehouse and AI solutions.
• Hands-on experience with cloud platforms (Azure, or GCP) and their data services.
• Deep understanding of Data Modeling, Data Warehousing, and Big Data Processing.
• Experience with Delta Lake, Lakehouse architecture, and Data Governance frameworks.
• Knowledge in Job Orchestration tools (e.g., Airflow, Data Factory, Glue).
• Familiarity with MLflow and machine learning pipelines is a plus.
• Experience in Managing Multiple Projects and working with distributed teams.
• Experience working in an Agile or Scrum development environment.
• Self-directed and capable of working effectively in a fast-paced environment.

Desired Skills

• Databricks Certification (Databricks Certified Data Engineer, Databricks Certified Associate Developer for Apache Spark, etc.).
• Experience with streaming data frameworks like Kafka, Kinesis, or Azure Event Hubs.
• Knowledge of containerization and orchestration tools like Docker and Kubernetes.

What To Expect

If you join our team, you can expect:

• To be part of a financially stable and fast-growing company.
• To be a critical part of our future and help shape our culture.
• To work hard, but respect family life and maintain a healthy work/life balance.
• To receive competitive compensation and benefits, as well as opportunities for learning and career advancement.
• To value relationships over transactions and apply data-centric strategies to solve specific business challenges.
• Fully remote position.
• Opportunity to work with multiple companies and diverse projects.
• Competitive salary and benefits package.
• Private medical Insurance included

This is a full-time role, not a freelance role.

Submit resumes in English for consideration.